tporret API Data Importer

Changelog

1.3.0

• Architectural deepening release — no breaking changes to existing import jobs, REST API, or admin UI.
• Extracted Tporapdi_Validator module: single entry point for all import job field validation (auth, recurrence, templates, post defaults, meta mappings) replacing scattered inline checks in rest.php.
• Extracted Tporapdi_Import_Runner module: owns the full 5-stage import lifecycle (Extract, Filter, Stage, Transform, Load) with state transitions and failure semantics in one place.
• Extracted Tporapdi_Template_Engine module: single render() seam used by both live import runs and dry-run previews, guaranteeing identical Twig security and output behaviour across all template fields.
• Extracted Tporapdi_Security_Guard module: centralises SSRF, CIDR, and Twig security validation — same rules enforced at save time and run time.
• Extracted three domain repositories (Tporapdi_Job_Repository, Tporapdi_Queue_Repository, Tporapdi_Log_Repository): all SQL and cache management moved out of db.php, which is now a thin backwards-compatible shim layer.
• Extracted Tporapdi_Media_Ingestor module: image sideload, deduplication, and HTML content rewriting isolated from lifecycle cleanup.
• Extracted Tporapdi_Cleanup_Service module: chunked garbage collection for staging queue and log tables, independent of media handling.
• Reporting Discovery Engine: reporters now self-register via TPORAPDI_Reporting_Aggregator::register(); reporting.php uses glob-based auto-discovery so new reporters require no edits to existing files.
• Extracted Tporapdi_Lock_Policy module: single is_locked(int $post_id) seam for all import-managed post edit-locking; all content.php hook callbacks route through this one policy.
• Deepened TPORAPDI_Defaults_Resolver: new normalize(string $post_type, array $raw_input) static method is the single seam for post status/comment status/ping status normalization — used identically by the REST save path and the import runtime.
• Updated the public plugin name to tporret API Data Importer for WordPress.org resubmission.

1.2.4

• Aligned Twig dry-run template normalization with save-time normalization so preview output matches persisted output.

1.2.3

• Added multisite Network Admin dashboard support while preserving per-site importer dashboards.
• Added multisite activation safeguards so unsupported Network Activate attempts are blocked and reverted.
• Added multisite admin guidance for primary-site activation requirements and network dashboard availability.
• Softened the SSRF Hardening reporter so fresh installs show a warning until an endpoint allowlist is configured.
• Tightened and de-duplicated release packaging workflows.

1.2.2

• Security hardening release.
• Encrypted credential storage at rest for auth_token and auth_password.
• REST import-job GET now masks credentials and returns has_auth_token / has_auth_password flags.
• Update handlers preserve existing encrypted credentials when masked fields are submitted blank.
• Removed raw token exposure from tporapdi_remote_request_args filter context.
• Added post-content sanitization with wp_kses_post before post insert/update.
• Added custom-meta sanitization with sanitize_text_field before update_post_meta.
• Tightened admin menu capability from read to manage_options.

1.2.1

• Maintenance release from cleaned git history.
• Removed accidentally committed documentation/test-data directories from repository history and release packaging.
• No runtime feature changes.

1.2.0

• Updated: React Import Job Workspace
  • Replaced the legacy linear create/edit form with a tabbed workspace in wp-admin.
  • Added sticky footer actions for save, run now, and update existing item content.
• Updated: REST Import Job CRUD + actions
  • Added REST routes for create/read/update import jobs and run/template sync actions.
  • Added centralized sanitization for import job payloads used by create/update handlers.
• Updated: API validation and preview tooling
  • Added in-workspace API test button with sample record preview support.
  • Added Twig dry-run test support from the Mapping & Templating tab.
• Updated: Authentication model
  • Added four auth methods per import job: none, bearer, custom API-key header, and basic auth.
• Updated: Optional templates for new imports
  • New imports can be created without title or mapping templates; templates can be added later.
• Updated: Per-import editing lock control
  • Added “Lock editing of imported posts” toggle in Mapping & Templating.
  • Edit/delete restrictions now apply by import configuration and can be disabled per job.
• Updated: Default target post settings
  • Added per-import defaults for Post Status, Post Author, Comment Status, and Pingback/Trackback Status in Mapping & Templating.
  • Added REST sanitization and persistence for these fields in import job create/update handlers.
  • Import load now applies these defaults during wp_insert_post() and sync updates discussion settings during wp_update_post().
• New: Enterprise Reporting Dashboard (Tableau-Style)
  • Real-time operations command center with global health status badge and force-refresh controls.
  • Nine enterprise-grade metrics across three pillars:
  • Environment Health: Cron heartbeat, queue depth, daily success rate.
  • Security & Compliance: SSRF hardening status, audit integrity tracking, protocol enforcement (HTTPS vs HTTP).
  • Connectivity & Performance: API latency trends, active endpoint count, hourly throughput.
  • High-performance React UI with Recharts data visualization and Lucide icons.
  • Responsive grid layout with KPI stat cards (sparkline trends), status lists, donut charts, area charts, and system pulse marquee.
  • REST API endpoints: /wp-json/eapi/v1/dashboard (metrics) and /wp-json/eapi/v1/dashboard/history (time-series data).
  • Transient-backed caching (600s TTL) with force-refresh capability.
  • Shimmer loading states and dark/light theme-aware styling via Tailwind CSS (namespaced to avoid wp-admin conflicts).
  • Menu: EAPI → Dashboard (requires read capability).
• Credential Encryption & Data Sanitization
  • Credential fields (auth_token, auth_password) are now encrypted at rest with AES-256-CBC using a key derived from wp_salt(‘auth’).
  • REST GET responses mask credential values and expose boolean has_auth_token / has_auth_password flags.
  • Credential preservation on update: blank credential fields retain existing encrypted values.
  • React auth fields show “Credential saved” indicators with placeholder text for stored credentials.
  • apply_filters(‘tporapdi_remote_request_args’) no longer passes raw token — passes auth_method instead.
  • Twig-rendered post content now passes through wp_kses_post() before wp_insert_post() (stored XSS prevention).
  • Twig-compiled custom meta values now pass through sanitize_text_field() before update_post_meta().
  • Admin menu pages capability changed from ‘read’ to ‘manage_options’ (subscriber access blocked).
• Enhanced Security Hardening (Enterprise-Grade)
  • Added dedicated tporapdi_manage_templates capability for template configuration access (separate from manage_options).
  • Implemented multisite-aware permission system: tporapdi_manage_templates OR manage_options OR is_super_admin().
  • Locked imported items as read-only (no editing, deletion, or quick-edit permissions via map_meta_cap).
  • Added comprehensive Twig template security validator:
  • Disallowed tags: include, source, import, from, embed, extends, use, macro (prevents SSTI and file inclusion).
  • Size limits: 50 KB for mapping templates, 2 KB for title templates (filterable).
  • Expression count limit: 250 default (filterable).
  • Nesting depth limit: 12 levels default (filterable).
  • Parse-time syntax validation via Twig tokenizer.
  • Added template change audit logging:
  • Logs to wp_custom_import_logs with before/after SHA256 hashes.
  • Captures actor metadata (user login, role, display name).
  • Tracks template lengths and create vs. update distinction.
  • Implemented SSRF prevention via allowlist system:
  • Hostname allowlisting (exact + wildcard *.example.com support).
  • CIDR allowlisting (IPv4 and IPv6 support).
  • DNS resolution for hostname validation.
  • Settings UI for managing allowed hosts and CIDR blocks.
  • Twig variable strictness is filterable; permissive rendering now avoids row failures when a template references a missing key.
  • Added Settings page (EAPI → Settings) for endpoint security configuration.

1.0.0

• Initial Release.
• Added dynamic Twig Post Title Template support with sanitization and fallback logic.
• Added Target Post Type selector for loading imports into posts, pages, or public custom post types.
• Added runtime fallback to post when target post type is invalid or missing.
• Added secure media sideload helper foundation with source URL deduplication metadata.