FAQs: Data Stream

What is the data format?

• Data warehouse (for example, BigQuery): Ongoing partition table.
  Important: The same table is updated daily with new rows appended for each day’s data. A date stamp column indicates when each row was added. This structure allows direct querying of the latest data without creating new tables each day, simplifying data management.
• Apache Parquet or CSV: Raw format.

How much storage do I need?

The daily Data Stream package ranges from 5 GB to 15 GB (uncompressed). For data delivered to a warehouse, you can define how much historical data to retain. If storage is limited, you can configure your system to purge data older than a set period, such as six months.

Is Data Stream compatible with the data warehouse I'm using?

Data Stream supports direct delivery to GCP BigQuery and Amazon Redshift. It also supports delivery to cloud storage services such as Google Cloud Storage (GCS), Amazon S3, and Microsoft Azure Blob Storage if you prefer to ingest the data into your warehouse separately.

Are there any limitations or restrictions?

Data Stream supports a single delivery destination per configuration. For example, data cannot be delivered simultaneously to both S3 and BigQuery.

Can Demandbase deliver data if I don't use any of the data warehouses? 

If you do not use a supported data warehouse, Demandbase can host the data on your behalf. Reach out to your Demandbase Account Team for more information.

How do I get started with Data Stream?

If you’re interested in Data Stream, contact your Demandbase Account Team to get connected with the product team. They can answer questions and ensure the setup aligns with your needs.

You can also request a trial data package to explore the data and evaluate how it fits into your workflows. Trials include a 1-day data delivery. Due to the technical nature of Data Stream, a technical contact from your team is required to support setup and evaluation.

To set up the trial, you must provide the following information:

• The data warehouse or storage service where the data should be delivered
• The start date for the data delivery
• Trial or Full Delivery
• Account name & ID
• Contact person’s name 
• Contact person’s title
• Contact person’s email 
• Contact person’s phone number
• Technical contact name (if different from contact)
• Technical contact email (if different from contact)
• Technical contact phone number (if different from contact)
• Delivery start date
• Delivery destination: BigQuery/Redshift/Azure Synapse/GCS/S3/Azure Blob/Demandbase Hosted SFTP/Other
• Other delivery information

Does data in Data Stream match the data in Demandbase One?

The data delivered through Data Stream originates from the same source as the Demandbase One Platform, ensuring consistency between the two.

However, because Data Stream delivers data once daily with a cutoff at 12 AM EST, it does not include same-day data. This may create discrepancies when comparing Data Stream data with the Demandbase One Platform later in the day.

What is the difference between Demandbase Data Stream and Demandbase Data Export API?