Darksky feature snapshot

A high-level look at Stitch's Darksky (v1) integration, including release status, useful links, and the features supported in Stitch.

STITCH
Release status

Released on January 3, 2020

 Supported by

Singer Community
Stitch plan

Standard

 API availability

Available
Singer GitHub repository

singer-io/tap-darksky
REPLICATION SETTINGS
Anchor Scheduling

Supported

 Advanced Scheduling

Supported
Table-level reset

Unsupported

 Configurable Replication Methods

Unsupported
DATA SELECTION
Table selection

Unsupported

 Column selection

Unsupported
Select all

Unsupported
TRANSPARENCY
Extraction Logs

Supported

 Loading Reports

Supported

Connecting Darksky

Step 1: Retrieve your Darksky secret key

  1. Log into your Darksky API account here.
  2. On your account home page, your Secret Key is available at the top of the page. You will use this Secret Key to add your integration.

Step 2: Add Darksky as a Stitch data source

  1. Sign into your Stitch account.

  2. On the Stitch Dashboard page, click the Add Integration button.

  3. Click the Darksky icon.

  4. Enter a name for the integration. This is the name that will display on the Stitch Dashboard for the integration; it’ll also be used to create the schema in your destination.

    For example, the name “Stitch Darksky” would create a schema called stitch_darksky in the destination. Note: Schema names cannot be changed after you save the integration.

  5. In the Language field, enter the language code. Ex: ‘en’ for English, ‘es’ for Spanish, and ‘fr’ for French. For a full list of available language codes, check the Request Parameters section of the Darksky API documentation.
  6. In the Location List field, enter the latitude and longitude of the the locations to be returned for weather forecast information. The locations must be semi-colon deliniated. Ex: <latitude>,<longitude> is an accepted value for a single location, and <latitude>,<longitude>;<latitude>,<longitude>; ... etc is accepted for multiple locations.
  7. In the Secret Key field, paste your Darksky secret key that you retrieved in Step 1.
  8. In the Units field, enter the measurement system to be returned for weather forecast information. Ex: ‘us’ for Imperial Units, and ‘si’ for International System of Units. For a full list of available measurement systems, check the Request Parameters section of the Dark Sky API documentation

Step 3: Define the historical replication start date

The Sync Historical Data setting defines the starting date for your Darksky integration. This means that data equal to or newer than this date will be replicated to your data warehouse.

Change this setting if you want to replicate data beyond Darksky’s default setting of 1 year. For a detailed look at historical replication jobs, check out the Syncing Historical SaaS Data guide.

Step 4: Create a replication schedule

In the Replication Frequency section, you’ll create the integration’s replication schedule. An integration’s replication schedule determines how often Stitch runs a replication job, and the time that job begins.

Darksky integrations support the following replication scheduling methods:

To keep your row usage low, consider setting the integration to replicate less frequently. See the Understanding and Reducing Your Row Usage guide for tips on reducing your usage.

Initial and historical replication jobs

After you finish setting up Darksky, its Sync Status may show as Pending on either the Stitch Dashboard or in the Integration Details page.

For a new integration, a Pending status indicates that Stitch is in the process of scheduling the initial replication job for the integration. This may take some time to complete.

Free historical data loads

The first seven days of replication, beginning when data is first replicated, are free. Rows replicated from the new integration during this time won’t count towards your quota. Stitch offers this as a way of testing new integrations, measuring usage, and ensuring historical data volumes don’t quickly consume your quota.

Darksky table reference

forecast

View table schema on GitHub
Replication Method :

Key-based Incremental

 Replication Key :

forecast_date
Primary Key :

forecast_date : latitude : longitude

 API endpoint :

Time Machine Request

The forecasts table contains weather conditions for a particular date and location. The locations are determined by the locations entered into the Locations field in Stitch.

Note: The units data points are returned in is determined by the value entered into the Units field in Stitch. For example: If us is entered, data will be returned in Imperial units.

forecast table schema

forecast_date
DATE-TIME

The date and local time based on the requested latitude and longitude.

latitude
NUMBER

The requested latitude.

longitude
NUMBER

The requested longitude.

daily
OBJECT

A data block containing the weather conditions day-by-day for the next week.

Click to expand daily

apparent_temperature_high
NUMBER

The daytime high apparent temperature.

apparent_temperature_high_time
DATE-TIME

The UNIX time representing when the daytime high apparent temperature occurs.

apparent_temperature_low
NUMBER

The overnight low apparent temperature.

apparent_temperature_low_time
DATE-TIME

The UNIX time representing when the overnight low apparent temperature occurs.

apparent_temperature_max
NUMBER

The maximum apparent temperature during a given date.

apparent_temperature_max_time
DATE-TIME

The UNIX time representing when the maximum apparent temperature during a given date occurs.

apparent_temperature_min
NUMBER

The minimum apparent temperature during a given date.

apparent_temperature_min_time
DATE-TIME

The UNIX time representing when the minimum apparent temperature during a given date occurs.

cloud_cover
NUMBER

The percentage of sky occluded by clouds, between 0 and 1, inclusive.

dew_point
NUMBER

The dew point in degrees Fahrenheit.

humidity
NUMBER

The relative humidity, between 0 and 1, inclusive.

icon
STRING

A machine-readable text summary of this data point, suitable for selecting an icon for display. Possible values are:

  • clear-day
  • clear-night
  • rain
  • snow
  • sleet
  • wind
  • fog
  • cloudy
  • partly-cloudy-day
  • partly-cloudy-night

moon_phase
NUMBER

The fractional part of the lunation number during the given day: a value of 0 corresponds to a new moon, 0.25 to a first quarter moon, 0.5 to a full moon, and 0.75 to a last quarter moon.

precip_accumululation
NUMBER

The amount of snowfall accumulation expected to occur - over the hour or day, respectively - in inches. If no snowfall is expected, this property will not be defined.

precip_intensity
NUMBER

The intensity, in inches of liquid water per hour, of precipitation occurring at the given time. This value is conditional on probability.

precip_intensity_max
NUMBER

The maximum value of precip_intensity during a given day.

precip_intensity_max_time
DATE-TIME

The maximum value of precip_intensity during a given day.

precip_probability
NUMBER

The probability of precipitation occurring, between 0 and 1, inclusive.

precip_type
STRING

The type of precipitation occurring at the given time. If defined, this property will have one of the following values: rain, snow, or sleet.

pressure
NUMBER

The sea-level air pressure in millibars.

summary
STRING

A human-readable text summary of this data point.

sunrise_time
DATE-TIME

The UNIX time of when the sun will rise during a given day.

sunset_time
DATE-TIME

The UNIX time of when the sun will set during a given day.

temperature_high
NUMBER

The daytime high temperature.

temperature_high_time
DATE-TIME

The UNIX time representing when the daytime high temperature occurs.

temperature_low
NUMBER

The overnight low temperature.

temperature_low_time
DATE-TIME

The UNIX time representing when the overnight low temperature occurs.

temperature_max
NUMBER

The maximum temperature during a given date.

temperature_max_time
DATE-TIME

The UNIX time representing when the maximum temperature during a given date occurs.

temperature_min
NUMBER

The minimum temperature during a given date.

temperature_min_time
DATE-TIME

The UNIX time representing when the minimum temperature during a given date occurs.

time
DATE-TIME

The UNIX time at which this data point begins.

uv_index
INTEGER

The UV index.

uv_index_time
DATE-TIME

The UNIX time of when the maximum uv_index occurs during a given day.

visibility
NUMBER

The average visibility in miles, capped at 10 miles.

wind_bearing
INTEGER

The direction that the wind is coming from in degrees, with true north at 0° and progressing clockwise.

wind_speed
NUMBER

The wind speed in miles per hour.
forecast (table), daily (attribute)

end_time
DATE-TIME

flags
OBJECT

Various metadata information related to the request.

Click to expand flags

nearest_station
NUMBER

The distance to the nearest weather station that contributed data to this response.

sources
ARRAY

An array of IDs for each data source utilized in servicing this request.

units
STRING

Indicates the units which were used for the data in this request.
forecast (table), flags (attribute)

hourly
OBJECT

The various weather phenomena occurring over an hour.

Click to expand hourly

data
ARRAY

The weather conditions at the requested location over time.

Click to expand data

apparent_temperature
STRING

The apparent (or ‘feels like’) temperature in degrees Fahrenheit.

cloud_cover
NUMBER

The percentage of sky occluded by clouds, between 0 and 1, inclusive.

dew_point
NUMBER

The dew point in degrees Fahrenheit.

humidity
NUMBER

The relative humidity, between 0 and 1, inclusive.

icon
STRING

A machine-readable text summary of this data point, suitable for selecting an icon for display. Possible values are:

  • clear-day
  • clear-night
  • rain
  • snow
  • sleet
  • wind
  • fog
  • cloudy
  • partly-cloudy-day
  • partly-cloudy-night

precip_intensity
NUMBER

The intensity, in inches of liquid water per hour, of precipitation occurring at the given time. This value is conditional on probability.

precip_probability
NUMBER

The probability of precipitation occurring, between 0 and 1, inclusive.

precip_type
STRING

The type of precipitation occurring at the given time. If defined, this property will have one of the following values: rain, snow, or sleet.

pressure
NUMBER

The sea-level air pressure in millibars.

ozone
NUMBER

The columnar density of total atmospheric ozone at the given time in Dobson units.

summary
STRING

A human-readable text summary of this data point.

temperature
NUMBER

The air temperature in degrees Fahrenheit.

time
DATE-TIME

The UNIX time at which this data point begins.

uv_index
INTEGER

The UV index.

visibility
NUMBER

The average visibility in miles, capped at 10 miles.

wind_bearing
INTEGER

The direction that the wind is coming from in degrees, with true north at 0° and progressing clockwise.

wind_gust
NUMBER

The wind gust speed in miles per hour.

wind_speed
NUMBER

The wind speed in miles per hour.
forecast (table), data (attribute)

icon
STRING

A machine-readable text summary of this data block.

summary
STRING

A human-readable summary of this data block.
forecast (table), hourly (attribute)

local_date
STRING

offset
NUMBER

The current timezone offset in hours.

start_time
DATE-TIME

timezone
STRING

The IANA timezone name for the requested location. This is used for text summaries and for determining when hourly and daily data block objects begin.
Related Troubleshooting
Questions? Feedback?

Did this article help? If you have questions or feedback, feel free to submit a pull request with your suggestions, open an issue on GitHub, or reach out to us.