Metadata Cache

For cloud data sources that allow modifying their objects and adding custom objects and/or fields, Skyvia caches metadata by default. Skyvia caches metadata, because reading metadata from a cloud source may take much time, and reloading it every time a connection is used decreases performance. However, you may change this behavior when creating or editing a connection to such data source, by changing a value of the Metadata Cache parameter.

This parameter determines how often to update cached metadata for the connection. You can configure how often the cache is refreshed automatically or reset it manually in the Connection Details of the corresponding connection by clicking the Clear Cache button. The following values are available for this parameter:

  • Disabled - the metadata cache is not created, and metadata are queried automatically whenever the connection is opened.
  • One Hour - the metadata cache expires after one hour since the previous refresh, and it is refreshed after this when the connection is opened.
  • One Day - the metadata cache expires after one day since the previous refresh, and it is refreshed after this when the connection is opened.
  • One Week - the metadata cache expires after one week since the previous refresh, and it is refreshed after this when the connection is opened.
  • One Month - the metadata cache expires after one month since the previous refresh, and it is refreshed after this when the connection is opened.
  • Infinite - the cache is never reset automatically. Default value.

By default, the Metadata Cache parameter is set to Infinite, and cache is reset only manually. If metadata of your cloud application changes often, you may need to change this setting.

Metadata Cache parameter

Metadata Changes

If metadata of your cloud app changes, by default, Skyvia knows nothing about it. If some fields or objects in your data source that are used in your integration packages, backups, or endpoints, are deleted, this will cause errors next time when the integration package or backup runs, or endpoint data are queried. If an object is added in the data source, existing backups, integration packages, etc. will not fail; however, Skyvia will not know about these changes till metadata cache is cleared.

Unless you set the Metadata Cache parameter of your connection to Disabled or to a short period, you will need to edit your connection and click the Clear Cache button. In some cases you will also need to edit your backups or integration packages and apply the corresponding changes to them.

You can easily find out which objects use a specific connections using the View Dependencies button in the connection details.

List of Connectors with Metadata Cache

  • Salesforce
  • Dynamics CRM
  • SugarCRM
  • Zoho CRM
  • NetSuite*
  • QuickBooks Online
  • FreshBooks
  • Salesforce Marketing Cloud*
  • MailChimp*
  • HubSpot
  • Marketo
  • BigCommerce
  • Magento
  • Freshdesk
  • Zendesk

* These connectors also have additional settings, determining whether their custom objects or fields are available via Skyvia