Data Management

Global exchange holiday calendars, DST transition handling, multi-timezone session scheduling, multi-currency P&L, ISIN/CUSIP/SEDOL cross-referencing.

Skills: 37
Hand off: 221
Handed off from: 314

Index

All 37 skills in this domain, alphabetically. Hover a row for its situation; open it for the full playbook.

C

corporate-action-event-calendar-integrationUse when ingesting corporate action calendars and tracking the declaration, ex-date, record date and payment date lifecycle to compute dividend entitlements and audit vendor feed parity. Building adjusted prices is corporate-action-adjusted-backtesting.event-calendar cross-region-data-replication-lag-monitoringUse when a multi-region database or event stream can serve a stale read to a trading process, measuring replication lag against P95 and P99 targets and recommending a read failover before the staleness matters.data-replication cross-vendor-timestamp-precision-reconciliationUse when a pipeline ingests timestamps from several vendors in different units and encodings, normalising seconds, milliseconds, ISO-8601 and nanoseconds to integer nanosecond UTC and flagging precision loss and out-of-order arrivals.nanoseconds currency-pair-quoting-convention-normalizationUse when FX vendors disagree about which currency is the base and an inverted quote would flip a signal; ranks pairs against the interbank convention, inverts backwards quotes and sizes pips and spreads consistently.currency-pair

D

data-lineage-tracking-for-audit-and-debuggingUse when an anomalous signal or unexplained backtest jump needs upstream and downstream tracing, maintaining an append-only lineage graph across market data, feature store and model decisions.dag-lineage data-pipeline-schema-contract-testingUse at the ingestion edge, to enforce field types, nullability and value bounds against a declared contract and catch silent vendor schema drift such as a renamed field or a price arriving as a string.data-quality data-quality-monitoring-dashboardUse when monitoring feed completeness, timeliness, outliers, uniqueness and liveness across market data vendors, to catch null prices, latency spikes and stalled feeds before an algorithm trades on them.observability data-retention-policy-and-storage-tieringUse when planning the lifecycle that moves tick archives, backtest outputs and trade logs across hot, warm, cold and deep-archive tiers, without deleting anything a retention rule still requires.storage-tiering data-vendor-contractual-usage-restriction-trackingUse when an internal system asks for vendor market data and the firm must decide whether that purpose is inside the licensed scope: use case, non-display entitlement, redistribution and seat caps, failing closed with a reason.data-licensing daylight-saving-time-transition-handlingUse when a session boundary or scheduled job is expressed in exchange-local time and daylight saving shifts it; resolves local boundaries to UTC across zones and flags skipped and repeated wall-clock times.timezone-handling

E

exchange-tick-size-regime-trackingUse when a limit price is constructed programmatically and must be a legal increment on the destination venue: SEC Rule 612 penny and sub-penny bands, and the MiFID II RTS 11 price-by-liquidity grid.exchange-rules

G

global-exchange-holiday-calendar-handlingUse when a bot or backtest spans more than one country's exchange and a foreign holiday would otherwise be traded as a normal session. A calendar of what was scheduled, not a live halt feed.exchange_calendars-(python)global-macro-economic-calendar-integrationUse when a live system must stop quoting around scheduled macro releases such as FOMC, CPI and payrolls, resolving release timestamps across daylight saving and resuming only when the window has genuinely closed.economic-events

H

historical-data-backfill-rate-limit-managementUse when pulling years of history from a metered vendor REST API, pacing requests with a token bucket and handling 429 responses with full-jitter backoff and Retry-After, so the backfill finishes instead of being banned.backfill historical-order-book-reconstruction-from-message-logsUse when the input is a market-by-order message log rather than aggregated depth, replaying add, cancel, delete, execute and replace into price-level depth and best bid and offer, with explicit gap detection.level-3-itch historical-tick-data-storage-and-compactionUse when designing a tick archive that must stay affordable, delta-encoding timestamps and prices, laying columns out for compression, choosing a Parquet codec and tiering partitions by age.parquet

I

instrument-universe-change-detection-and-alertingUse when diffing daily tradable-universe snapshots on permanent identifiers rather than tickers, to catch additions, delistings, renames such as FB to META, venue migrations and trading-status transitions.security-master isin-cusip-sedol-cross-reference-serviceUse when building a security master or validating symbols at order entry, checking ISIN, CUSIP, SEDOL and FIGI check digits and resolving any one of them to the others. A valid check digit is not proof the security exists.cusip

M

market-data-cost-optimization-tiered-subscriptionsUse when the symbol universe is far larger than what is actually traded and the data bill scales with symbol count, assigning each symbol to a direct-depth, real-time or delayed tier from its live position and signal state.cost-optimization market-data-latency-monitoring-per-vendorUse when a feed is suspected of being slow and the question is which party owns the delay, decomposing the exchange-to-application path into vendor transport, network wire and application queue segments.latency-monitoring market-data-simulator-for-offline-developmentUse when developing strategy, risk or feed-handler code with no live subscription and no recorded session, generating a deterministic synthetic top-of-book stream. A synthetic path cannot demonstrate edge.simulator multi-currency-pnl-and-fx-conversionUse when a book holds positions in more than one currency and P&L must not be summed across units, resolving point-in-time FX rates and separating trading result from currency translation.multi-currency multi-source-price-reconciliation-tie-breakingUse when three or more vendors quote the same instrument and one canonical price must come out, with median-distance outlier attribution and a tick-size-aware agreement tolerance. Two sources cannot break a tie.price-reconciliation multi-timezone-session-schedulingUse when scheduling logic references market open or close for an exchange in another time zone, resolving local trading hours to UTC across daylight saving instead of a hardcoded offset. Pair it with a holiday calendar.iana-tz-database

O

options-chain-data-normalization-across-vendorsUse when options chains arrive from several vendors under different symbology, date formats and sentinel values, mapping them to the OCC 21-character standard with mid-prices and an integrity audit.osi-symbology options-chain-expiry-cycle-conventions-by-exchangeUse when a chain model, roll scheduler or expiry-day process needs the contractual terms rather than a rule of thumb: the monthly-cycle expiry date per exchange, the last trading day, and when they differ.expiry-cycles options-implied-volatility-surface-constructionUse when calibrating a surface to live quotes and you need evidence it holds no static arbitrage, inverting Black-Scholes prices to implied volatilities and fitting a smile per expiration with butterfly and calendar checks.volatility-smile

P

point-in-time-fundamentals-data-joinsUse when joining filed fundamentals to price bars, because a join on period end asserts the numbers were known on the last day of the quarter; resolves the value publicly available at each as-of date instead.point-in-time point-in-time-index-constituent-trackingUse when a backtest needs the names actually in an index on a historical date, resolving an addition and deletion log into half-open membership intervals so survivorship bias cannot enter the universe.point-in-time

R

real-time-vs-delayed-data-entitlement-handlingUse at the point a consumer asks for data and something must decide between a live stream, a delayed stream carrying its delay label, or a refusal, using each venue's own delay definition. Depth and non-display licensing is separate.real-time-data reference-data-change-notification-pipelineUse when an instrument-master record is refreshed and something downstream will act on it, separating identity and routing changes such as symbol or ISIN from order-construction changes such as lot size or tick size.change-detection reference-data-golden-source-designationUse when several vendors describe the same instrument and one record must go into the master, resolving each field by priority-ranked source with a recorded basis, and refusing to guess when no rule applies.reference-data reference-data-symbol-mapping-across-vendorsUse when data from several vendors must join on the same instrument across tickers, RICs, ISINs, CUSIPs, SEDOLs and FIGIs, resolving each to one canonical internal symbol point-in-time and back again.reference-data

S

synthetic-continuous-futures-contract-constructionUse when a futures strategy needs one long price history from separately expiring contracts, splicing them with volume, open-interest or calendar roll triggers and additive or proportional back-adjustment.continuous-series

U

unicode-and-encoding-issues-in-global-instrument-namesUse when instrument names arrive in mixed encodings such as Shift-JIS, GBK, EUC-KR or Latin-1 and must survive the pipeline intact, covering byte-order-mark detection, mojibake repair and Unicode normalisation.encoding

V

vendor-outage-fallback-data-source-hierarchyUse when the same instrument comes from several vendors at different quality tiers and a live process must pick one on every tick, with priority-ranked failover on staleness and outage. It picks a source; it does not compare them.vendor-outage vendor-specific-adjustment-methodology-reconciliationUse when historical series from different vendors disagree because each applies a different corporate action convention, modelling total-return, proportional, price-return and raw adjustment and reconciling the cumulative factors.vendor-reconciliation

Search the whole catalog