January 2024

Replication

We’re excited to introduce enhancements to Replication, featuring a new replication runtime and a range of new features to elevate your data replication experience.

New Replication Runtime

Enjoy a boost in performance and improved usability by selecting the new replication runtime checkbox in the replication settings. New replication runtime comes in with the object-specific LastSyncTime, improved error handling, and new replication modes.

Object-Specific LastSyncTime

Gain better control over your data replication with the object-specific LastSyncTime. Unlike the previous replication-wide setting, you can now set LastSyncTime for each object independently. This approach provides several benefits:

  • Prevents the failure of the whole replication in case of the errors with one or more objects.
  • Allows to add new objects for replication and create tables for them in Target without recreating tables for other objects marked for replication.
  • Streamlines the error handling by providing errors for each object that failed to replicate and separating them from the integration-level errors.
  • New replication modes, combined with the object-specific LastSyncTime setting allows for better replication customization on the object level. For example, when you use the incremental replication, you no longer need to create a separate replication for the objects that do not support incremental updates.

Replication Modes

Now you can use the replication modes to define the behaviour of the next replication for each object:

  • Standard mode is assigned to each object automatically and applies the default replication behaviour.
  • Resync mode forces the full replication of the object by dropping and creating a table in Target during each replication run.
  • Resync on demand mode is created for objects that are part of your replication, but are not required for each replication run. In the manual mode you can include the object to the next replication run by resetting its LastSyncTime.

Improved Performance, Removed Direct ID Check

We reworked the mechanism of applying changes to data in Target to boost the replication performance. New approach does not include the check of the IDs, so we removed this option.

No More Foreign Keys

As the objects in the new replication runtime do not depend on each other, we no longer create foreign keys for the replicated objects.

New Replication Features

We are happy to introduce new replication features that provide object history analysis capabilities, alternative ways to work with the nested objects, and the functionality to address compliance issues by hashing your data.

History Mode

Track the history of the entries in your database with the History mode. Enable it for the chosen objects in Source to store every change made to the objects’ rows in Target using the type 2 slowly changing dimension concept. In this case Skyvia will replace the Update operation with Insert and will add three more columns (status, start date, end date) to the table in Target, so you can perform the data analysis for the specific date or period of time.

Nested Objects Replication

Now you can choose how to represent fields with complex structured data with the help of the Unwind Nested Objects option. Select JSON Columns to replicate nested object fields as columns with JSON data into the target table or select Separate Tables to replicate nested object fields into additional tables in the database.

Once you’ve selected the preferred Unwind Nested Objects option you can manage it for each object separately in the Task Editor.

Data Hashing

Address compliance requirements with data hashing. Select specific object fields to hash, ensuring the secure transfer of sensitive data. For example, hash the customers’ emails data to provide an added layer of privacy without sacrificing analytical utility. To ensure that the data cannot be decoded with the knowledge of the default hashing algorithm we use a unique salt.

Automation

We are excited to announce that Automation is out of beta now. Thank you for your valuable feedback and support during the beta period. We continue to work on further development of the Automation product and will keep you informed regarding all the upcoming updates. As for now, we invite you to try it out and automate your workflows.

New Connectors

Tempo

Tempo is a time management platform offering various valuable tools such as timesheets, planner, cost tracking tool, resource management, etc.

Front

Front is a cloud-based customer operations platform that enables support, sales, and account management teams to streamline communication and deliver service at scale.

ClickUp

ClickUp is a cloud solution offering project management and collaboration tools such as task and time tracking, team chat, project whiteboard, etc.

Connector Updates

Klaviyo

Authorization

The Public API Key parameter is deprecated. You need only the Private API Key to connect to Klaviyo.

New Objects

We have added BulkProfiles and ImportBulkProfiles objects to our connector.

Updated Objects

We have added the CreatedDate and UpdatedDate fields to the Lists object. From now on, Skyvia supports the Synchronization and Incremental Replication for this object.

Deprecated Objects and Procedures

The following objects are deleted from our Klaviyo connector: CampaignRecipients, Campaigns, EmailTemplates, ListExclusions, ListMembers, ListSubscribe, MetricTimeline, PeopleExclusions.

The following procedures are deleted from the connector: Track, Identify, IdentifyProperties.

Brevo

New Connection Parameters

We added Suppress Extended Requests and Use Custom Fields connection parameters to the Brevo connector.

Enable Suppress Extended Requests to reduce the number of API calls and increase the speed of processing Contacts and ContactLists objects. Note that enabling this parameter will disable the incremental replication of the ContactLists object. Use Custom Fields parameter defines whether Skyvia will process the custom fields of the Contacts object. Enable it to Insert and Update custom field values. Brevo has precreated Email, Lastname, Firstname, and SMS custom fields that were previously displayed in Skyvia with the Attributes_ prefix. Now, they will be named according to the Contact Attribute Name.

Xero

We have supported Xero Project API in our connector. The Project, ProjectTask, ProjectTime, and ProjectUser objects are now available in Skyvia. More details are available in Xero documentation.

Podio

We have optimized the Items object and supported filters by the AppItemId, Title, CreatedVia_AuthClientId, and ExternalId. For user convenience, we added the separate read-only ItemFields object that stores the Fields field content in a tabular format. Skyvia automatically creates the separate <App Name>Items object, containing items specific to each application. More details are available in Podio topic.

QuickBooks Desktop

We have added new objects to our Quickbooks Desktop connector: Charge, Check, CheckExpenseLine, CheckLineItem, CreditCardCharge, CreditCardChargeExpenseLine, CreditCardChargeLineItem, CreditCardCredit, CreditCardCreditExpenseLine, CreditCardCreditLineItem. More details on the new object specifics are available in the QuickBooks Desktop topic.

Monday.com

Due to Monday.com migration to new 2023-10 API version we have updated our connector. More details are available in Monday.com topic.

Square

We have added a new GiftCards object and new LinkCustomerToGiftCard and UnlinkCustomerToGiftCard stored procedures to our connector. See more details in the Square connector topic.