Skip to content
Developer tools / Database · Two-way sync platform

Datadog and MarkLogic integration

Plan how Datadog and MarkLogic should share data across your business. Work with Stacksync engineers on record mapping, system access, and the requirements for running the integration.

  • Scope your workflow with an integration engineer
  • Review the systems, records, and updates you need
Integration planning
stacksync.com

Built for teams where self-serve, reliability and scale matter

Case study
Migrated from MuleSoft
Case study
Migrated from Celigo
Migrated from Heroku Connect
Migrated from Matillion
Case study
Migrated from Fivetran
Case study
Migrated from Celigo

Proposed workflow

Event or activity reporting workflow

Planning example. Stacksync support for the required connection and record operations needs a technical review.

Starting eventA change involving Datadog Events or the proposed event or activity table in MarkLogic needs a defined result in the other system.

  1. Start with Datadog Events and the proposed event or activity table in MarkLogic. Use the record-matching and field-ownership rules from your mapping worksheet.

  2. Resolve the related customer, user, or transaction identity without assuming the event ID is the entity ID.

  3. Test a normal update and one failed or repeated update in the supported direction. Keep both record IDs with the test results.

What to verifyDeliver the same event twice, then an older event after a newer one; verify duplicate and ordering behavior.

Review records and field ownership

Proposed record relationships

Records to connect

Use these examples to define record matching and field ownership for your technical review.

Download the mapping worksheet

CSV · No email required

Example record relationships between Datadog and MarkLogic
Datadog recordMarkLogic recordRecord matchingField ownership
EventsProposed record; confirm Stacksync object support.Reporting datasetProposed event or activity tableProposed table; choose its name and schema.Keep the source event ID, source system, occurrence time, and ingestion time. Use an explicit duplicate-detection key.Decide whether the destination stores an immutable history or only a current-state summary.
MetricsProposed record; confirm Stacksync object support.Reporting datasetProposed metric or analytical result tableProposed table; choose its name and schema.Identify a metric by definition/version, dimensions, time window, and entity key.The analytical model owns the computation; operational systems should receive only approved outputs with freshness context.

These relationships do not establish connector availability. Review the required connection and record operations with Stacksync.

Record coverage to review

Use documented coverage where available. Catalog record types are starting points for review and do not confirm Stacksync support.

Datadog

Connection and object support require review

Record types to review with Stacksync

Record typesCoverage and requirements
  • Monitors
  • Logs
  • Events
  • Dashboards
  • Metrics
  • Incidents
Confirm support for this record type and the direction you need.

Discuss Datadog requirements

MarkLogic

Connection and object support require review

Record types to review with Stacksync

Record typesCoverage and requirements
  • Documents
  • Collections
  • Semantic Triples
  • TDE Views
  • Document Metadata & Properties
  • Databases & Forests
Confirm support for this record type and the direction you need.

Discuss MarkLogic requirements

Connection essentials

Confirm Stacksync support and account requirements for undocumented connections. Interface information alone does not establish connector availability.

View setup requirements and limits
Connection requirementDatadogMarkLogic
Integration interfaceREST API (v1 and v2)REST API (Client API), plus SQL/ODBC access over TDE views and Java/Node client libraries
AuthenticationConfirm the credentials, API plan, and permissions required for Datadog.Confirm the credentials, API plan, and permissions required for MarkLogic.
Change detectionConfirm how Stacksync detects changes for this connector and the objects you need.Confirm how Stacksync detects changes for this connector and the objects you need.
Read accessConfirm with StacksyncConfirm with Stacksync
Write accessConfirm with StacksyncConfirm with Stacksync

Enterprise controls

Security and control for your integrations

Explore security controls

Compliance and data transfers

As a data company, we understand the importance of keeping your data secure. Stacksync is built with security best practices to keep your data safe at every layer, and is DPF-certified for US, EU, UK and CH data transfers.

  • SOC 2 Type II
  • ISO 27001
  • HIPAA BAA
  • GDPR
  • CCPA
  • DPF US-EU-UK-CH

SSO & SCIM

Let your users access Stacksync from your centralized user management systems. Works with Okta, Azure, Google SSO and more.

Alerts

Immediately get alerted about record syncing issues over email, Slack, PagerDuty and WhatsApp. Resolve issues from a centralized dashboard with retry and revert options.

Secure connection options

Record-level recovery

Inspect sync errors and use retry and revert controls to resolve failed updates.

Read the recovery guide

Implementation

Technical reference

Review setup, record relationships, testing, and recovery for your implementation.

Authentication, permissions and API limits

Connection requirements and limits

Datadog
Integration interface
REST API (v1 and v2)
Authentication
Confirm the credentials, API plan, and permissions required for Datadog.
Change detection
Confirm how Stacksync detects changes for this connector and the objects you need.
Read access
Confirm with Stacksync
Write access
Confirm with Stacksync
Setup requirements
  • Identify the Datadog account, edition, environment, and business objects the integration must access.
  • Confirm a Stacksync connector or implementation path for Datadog, including read/write support, authentication, and initial-load limits.
Limitations to check
  • Confirm Stacksync support for Datadog and the record types your workflow needs.
  • Review write-back, deletion handling, update timing, and account limits with the integration team.
MarkLogic
Integration interface
REST API (Client API), plus SQL/ODBC access over TDE views and Java/Node client libraries
Authentication
Confirm the credentials, API plan, and permissions required for MarkLogic.
Change detection
Confirm how Stacksync detects changes for this connector and the objects you need.
Read access
Confirm with Stacksync
Write access
Confirm with Stacksync
Setup requirements
  • Identify the MarkLogic account, edition, environment, and business objects the integration must access.
  • Confirm a Stacksync connector or implementation path for MarkLogic, including read/write support, authentication, and initial-load limits.
Limitations to check
  • Confirm Stacksync support for MarkLogic and the record types your workflow needs.
  • Review write-back, deletion handling, update timing, and account limits with the integration team.

Prepare Datadog and MarkLogic access

Set up both accounts before testing the mapping. Use test records where available, and identify the account administrator who can approve access and help resolve setup errors.

Datadog setup checklist
  • Identify the Datadog account, edition, environment, and business objects the integration must access.
  • Confirm a Stacksync connector or implementation path for Datadog, including read/write support, authentication, and initial-load limits.
MarkLogic setup checklist
  • Identify the MarkLogic account, edition, environment, and business objects the integration must access.
  • Confirm a Stacksync connector or implementation path for MarkLogic, including read/write support, authentication, and initial-load limits.
Prepare to go live

Record the fields each system can update, the first-load cutoff, both record IDs, the expected update delay, and who handles errors. Complete the tests before production before expanding to more records.

Use the Datadog and MarkLogic planning worksheet to capture these decisions. Record the access owner in the worksheet and enter credentials only in the connection setup.

Talk to an engineer · Review current pricing

Record identity and field ownership

Use these data-model references to describe the records your connection needs. They are planning examples; connector availability and supported operations must be established before implementation.

Download the mapping worksheet · CSV, no email required

Reporting dataset

Events / Proposed event or activity table in MarkLogic (choose its name)

Plan a event or activity dataset while preserving its source meaning.

Planning example. Stacksync support for the required connection and record operations needs a technical review.

Datadog
Object support to establish
MarkLogic
Your database schema
Record identity
Keep the source event ID, source system, occurrence time, and ingestion time. Use an explicit duplicate-detection key.
Field ownership
Decide whether the destination stores an immutable history or only a current-state summary.

Fields to include

  • Source event ID
  • Event type
  • Occurred-at time
  • Related record ID
  • Payload version
Record dependencies
Resolve the related customer, user, or transaction identity without assuming the event ID is the entity ID.
Validation
Deliver the same event twice, then an older event after a newer one; verify duplicate and ordering behavior.
Recovery
Identify side effects already completed before replaying an event; use the agreed deduplication key.

Reporting dataset

Metrics / Proposed metric or analytical result table in MarkLogic (choose its name)

Plan a metric or analytical result dataset while preserving its source meaning.

Planning example. Stacksync support for the required connection and record operations needs a technical review.

Datadog
Object support to establish
MarkLogic
Your database schema
Record identity
Identify a metric by definition/version, dimensions, time window, and entity key.
Field ownership
The analytical model owns the computation; operational systems should receive only approved outputs with freshness context.

Fields to include

  • Metric definition
  • Entity reference
  • Time window
  • Value
  • Computed-at time
Record dependencies
Resolve entity keys, time zones, aggregation grain, and any currency/unit conversions.
Validation
Compare identical time windows and dimensions; test late-arriving data and a recalculated metric.
Recovery
Recompute the intended window before retrying an output; avoid overwriting a newer result with an older computation.

Compare integration approaches

Choose a method around one example record and the update your business needs. Use Events / Proposed event or activity table in MarkLogic (choose its name) to review record matching and confirm Stacksync support for the required operations. Compare ongoing sync, a custom workflow, and a scheduled export against that requirement.

Stacksync managed sync

Best fit
Review compatibility with a Stacksync engineer using an example of the records and updates you need.
Operating responsibility
Fits ongoing record synchronization when the required operations are supported. Add workflow steps for approvals or business actions that go beyond copying fields.
Before you choose
Check record matching: Keep the source event ID, source system, occurrence time, and ingestion time. Use an explicit duplicate-detection key. Verify field coverage, deletion handling, and how changes are detected.

Native vendor integration

Best fit
A vendor-built integration may fit if it supports your Datadog and MarkLogic record types.
Operating responsibility
Can reduce setup for a supported workflow. You may need another method for records or business steps it does not cover.
Before you choose
First check whether either vendor offers this integration. If available, verify Events / Proposed event or activity table in MarkLogic (choose its name), update direction, account tier, and related-record handling.

Custom API or workflow

Best fit
Consider when Datadog and MarkLogic need a transformation, approval, or action outside a direct record sync.
Operating responsibility
Provides control over business steps; the team owns credentials, version changes, error queues, and reconciliation.
Before you choose
Verify endpoint permissions, pagination, quotas, duplicate detection, and failure recovery.

File or scheduled snapshot

Best fit
Consider for a one-time Datadog / MarkLogic migration or a reporting need with an explicit freshness window.
Operating responsibility
Can simplify a bounded transfer; later changes and deletion history require another extraction or a separately designed incremental process.
Before you choose
Record the extraction cutoff, source IDs, encoding, date/number formats, and reconciliation totals.

Workflow scenarios and expected results

Event or activity reporting workflow

Planning example. Stacksync support for the required connection and record operations needs a technical review.

Starting event: A change to the selected Events or Proposed event or activity table in MarkLogic (choose its name) record needs a defined result in the other system.

  1. Start with Datadog Events and MarkLogic Proposed event or activity table in MarkLogic (choose its name). Use the record-matching and field-ownership rules from your mapping worksheet.
  2. Resolve the related customer, user, or transaction identity without assuming the event ID is the entity ID.
  3. Test a normal update and one failed or repeated update in the supported direction. Keep both record IDs with the test results.

Expected result: Deliver the same event twice, then an older event after a newer one; verify duplicate and ordering behavior.

If it fails: Identify side effects already completed before replaying an event; use the agreed deduplication key.

Metric or analytical result reporting workflow

Planning example. Stacksync support for the required connection and record operations needs a technical review.

Starting event: A change to the selected Metrics or Proposed metric or analytical result table in MarkLogic (choose its name) record needs a defined result in the other system.

  1. Start with Datadog Metrics and MarkLogic Proposed metric or analytical result table in MarkLogic (choose its name). Use the record-matching and field-ownership rules from your mapping worksheet.
  2. Resolve entity keys, time zones, aggregation grain, and any currency/unit conversions.
  3. Test a normal update and one failed or repeated update in the supported direction. Keep both record IDs with the test results.

Expected result: Compare identical time windows and dimensions; test late-arriving data and a recalculated metric.

If it fails: Recompute the intended window before retrying an output; avoid overwriting a newer result with an older computation.

Connect engineering context with MarkLogic

This is an evaluation scenario; connector and operation support require confirmation.

Starting event: An engineering record or operational event in Datadog needs a traceable relationship to Documents or Document Metadata & Properties.

  1. Identify Events or Metrics, its project or repository, and the event or issue ID.
  2. Decide whether MarkLogic should receive a status update, a linked work item, or a notification. A mirrored record does not establish permission to execute code or change infrastructure.
  3. Preserve event order and parent relationships, and define who approves actions that change data or trigger work.

Expected result: A repeated event creates no duplicate work or notification; the relationship points to the correct project and business record.

If it fails: Inspect completed side effects and current destination state before replaying the engineering event.

Initial load and acceptance testing

Keep both record IDs with the expected and actual result. Reconcile the same filters and time window in each system.

Events / Proposed event or activity table in MarkLogic (choose its name)

Test case

Deliver the same event twice, then an older event after a newer one; verify duplicate and ordering behavior.

Expected result

The expected event or activity relationship is preserved with no duplicate action or unintended write.

Metrics / Proposed metric or analytical result table in MarkLogic (choose its name)

Test case

Compare identical time windows and dimensions; test late-arriving data and a recalculated metric.

Expected result

The expected metric or analytical result relationship is preserved with no duplicate action or unintended write.

Direction and permissions

Test case

Bring an example source record and the intended destination operation to the compatibility review. Confirm the supported route before granting write access.

Expected result

Only an approved, supported direction and permitted fields are written.

Freshness and reconciliation

Test case

Measure source and destination times for the selected records under normal load and a burst. Reconcile IDs and values using the same filters and cutoff.

Expected result

The process meets its agreed freshness target and reconciliation has no unexplained differences.

Failed updates, retries and recovery

Start with the failed record and the destination error, then inspect the source value, field requirements, and access.

Rejected or repeated event or activity change

Investigate

Inspect Datadog Events and MarkLogic Proposed event or activity table in MarkLogic (choose its name), their IDs, and the destination error.

Next action

Identify side effects already completed before replaying an event; use the agreed deduplication key.

Rejected or repeated metric or analytical result change

Investigate

Inspect Datadog Metrics and MarkLogic Proposed metric or analytical result table in MarkLogic (choose its name), their IDs, and the destination error.

Next action

Recompute the intended window before retrying an output; avoid overwriting a newer result with an older computation.

A record type or update is unavailable

Investigate

Check the Datadog and MarkLogic connector guides, account permissions, and any operations marked On Request.

Next action

Ask the integration team to confirm a supported way to handle that record. Verify whether it needs connector configuration or a separate workflow step.

Source and destination disagree after a retry

Investigate

Compare current source values, destination validation, identity mappings, and any side effects already completed.

Next action

Stacksync issue retry reads the current source state. Decide the intended state before retrying or reverting; reconcile downstream effects separately.

Read the Stacksync issues dashboard guide for retry and revert behavior.

Change detection and update delivery

How updates move between Datadog and MarkLogic

See how each system detects changes and which updates the other system can receive. Each direction has its own permissions and record requirements.

Datadog MarkLogic Direction requires confirmation

Detect changesConfirm how Stacksync detects changes for this connector and the objects you need.

Apply updatesConfirm that Stacksync can create or update the records you need in MarkLogic.

MarkLogic Datadog Direction requires confirmation

Detect changesConfirm how Stacksync detects changes for this connector and the objects you need.

Apply updatesConfirm that Stacksync can create or update the records you need in Datadog.

Update timing and record limits
  • Measure initial-load and ongoing-change latency separately. Source detection, selected objects, account limits, and destination validation determine the observed delay.
  • Review write-back, deletion handling, update timing, and account limits with the integration team.
  • Review write-back, deletion handling, update timing, and account limits with the integration team.
FAQ

Datadog and MarkLogic integration FAQ

Next step

Plan your integration with an engineer

Walk through your Datadog and MarkLogic records, field mappings, and requirements with an integration engineer.