SnapLogic has announced the Fall 2015 release of its SnapLogic Elastic Integration Platform. The new release adds new capabilities for big data integration including Spark data processing, a new Snap for Cassandra and support for Microsoft Cortana Analytics, enabling customers to easily build pipelines that orchestrate and transform data using the frameworks of their choice. With the Fall 2015 release, SnapLogic customers can now connect to virtually any application or data source at any speed, anywhere — in the cloud, on premises and natively in a Hadoop or Spark cluster.

Article Index:

"Just as it takes data structures and algorithms to make programs, it takes app and data integration in the same platform to power the modern enterprise," said Gaurav Dhillon, founder and CEO of SnapLogic. "For too long IT organizations have had to choose between slow, batch ETL and code-heavy ESB for real time integration. Nine out of ten enterprises choose SnapLogic because data integration is an integral part of our unified platform. The Fall 2015 release brings big data integration to iPaaS and allows our customers to achieve maximum benefit from the new hybrid data architecture."

According to Forrester Research, "Your next-gen data management strategy must be informed by the current and future requirements of your entire business or it will be doomed to fail. But, it also must be pragmatic for you to implement it successfully."


Spark-Powered Pipelines

SnapLogic's platform-agnostic approach means that, as data volume or latency requirements change, the same pipeline can be used by changing the target platform to Hadoop or Spark. Building on SnapLogic's native Hadoop processing and SnapReduce capabilities, the Fall 2015 release adds:

The Sparkplex - SnapLogic customers can choose to run their data and application integrations in the cloud, on premises and natively in a Hadoop cluster. The new Sparkplex allows customers to choose to run their pipelines on Spark, which is optimal for real-time processing tasks. The Sparkplex consists of a Translator, which takes SnapLogic data pipelines and converts them to Spark code; a Coordinator, which connects the Sparkplex to the SnapLogic visual pipeline designer and dynamically scales nodes with the processing load; and Nodes, which scale out elastically within a big data cluster.

A new Spark Snap - SnapLogic provides 300+ pre-built intelligent connectors called Snaps. The Spark Snap enables customers to quickly create Spark-based pipelines using SnapLogic's intuitive, drag-and-drop interface. These high-performance pipelines can draw data from virtually any source and are ideally suited for memory-intensive, iterative processes. With this addition, customers can choose to use either MapReduce or Spark for data processing, depending upon factors such data size, latency requirements, and connectivity.

With the combination of the new Sparkplex and Spark Snap, SnapLogic customers enjoy the performance of Spark without the time and effort involved in creating and maintaining hand-coded integrations between data sources and a Spark cluster.


Flexible Platform for Big Data Integration

Also new with the Fall 2015 release is a Snap for Apache Cassandra, the scalable, NoSQL database designed to handle large datasets. With this addition, customers can choose the big data store best suited for the project at hand. The SnapLogic Elastic Integration Platform also supports Cloudera, Hortonworks and MapR, allowing customers to get more out of their investments in Hadoop by making it easier to get large amounts of data into and out of these systems.


Support for Microsoft Cortana Analytics Suite

SnapLogic also announced its support for the Microsoft Cortana Analytics Suite. The company now provides fast, self-service data connectivity to and from Cortana Analytics and Azure data services. Points of integration include Snaps for Microsoft Azure SQL Data Warehouse, Azure SQL Database, and Azure Blob Storage. SnapLogic's Snaplex can also be deployed on Azure resources (Azureplex).


Other Platform Enhancements

The SnapLogic Fall 2015 release brings usability enhancements for both the self-service and expert integrator, including:

Improvements to the visual pipeline Designer: the ability to create pipeline execution tasks directly from the drag-and-drop interface as well as the ability to re-order tabs in the Designer when working on a number of pipelines.

Account impact analysis: For large enterprises using multiple accounts for applications, administrators now have important visibility into which accounts are tied to specific dataflow pipelines.


New and Enhanced Snaps

SnapLogic continues to enhance its library of Snaps for data sources and endpoints on premises, in the cloud or in hybrid cloud environments.

New MultiJoin Snap: a streaming Snap that joins two or more streams at highly optimized performance.

Enhanced Snaps:

  • AWS DynamoDB
  • Azure Active Directory
  • Binary File Reader and Writer (AWS Security Token Service support)
  • Eloqua Update
  • Google BigQuery
  • JMS
  • REST Get
  • Microsoft SQL Server Bulk Load
  • Oracle RDBMS Bulk Load

Back To Top


This article was originally posted “SnapLogic Brings Big Data Integration To iPaaS” from Cloud Strategy Magazine.