Azure Databricks gives the most recent variants of Apache Spark and permits you to flawlessly coordinate with open source libraries. Turn up groups and construct rapidly in a completely overseen Apache Spark climate with the worldwide scale and accessibility of Azure. Introduction Azure Databricks SQL Analytics Azure Databricks Workspace How are...

The nested type is a specialised version of the object data type that allows arrays of objects to be indexed in a way that they can be queried independently of each other. Introduction Mapping Elasticsearch Nested Mapping Nested mapping and filter to the rescue Including nested values in parent documents Conclusion [contact-form-7 id="76417"...

Talend is an ETL tool for Data Integration. It provides software solutions for data preparation, data quality, data integration, application integration, data management and big data. Talend has a separate product for all these solutions. Data integration and big data products are widely used. Introduction to Talend Products Talend...

Pig is a high level scripting language that is used with Apache Hadoop. Pig enables data workers to write complex data transformations without knowing Java. Pig's simple SQL-like scripting language is called Pig Latin, and appeals to developers already familiar with scripting languages and SQL. Introduction to Apache pig Need of Pig Features of...

Apache HBase is used to have random, real-time read/write access to Big Data. It hosts very large tables on top of clusters of commodity hardware. Apache HBase is a non-relational database modeled after Google's Bigtable. Bigtable acts up on Google File System, likewise Apache HBase works on top of Hadoop and HDFS. Need for HBase HBase Use...

Microsoft Azure Data Lake is a highly scalable public cloud service that allows developers, scientists, business professionals and other Microsoft customers to gain insight from large, complex data sets. As with most data lake offerings, the service is composed of two parts: data storage and data analytics. Introduction ToAzure Data Lake What...

Rex command in splunk is used for field extraction in the search head. This command is used to extract the fields using regular expressions. This command is also used for replacing or substitute characters or digits in the fields by the sed expression. Introduction to Splunk Rex Rex command examples Rex and Erex Commands Rex...

A data pipeline is a service or set of actions that process data in sequence. This means that the results or output from one segment of the system become the input for the next. Introduction to data pipelining Why Is Building a Data Pipeline Important? Data pipeline components When do you need a data...

Removes the events that contain an identical combination of values for the fields that you specify. Introduction to Splunk Dedup The functionality of Splunk Dedup Differentiation between Uniq and Splunk Dedup commands Usage of Splunk Dedup command Lexicographical order Dedup as filtering command Different functions of Splunk Dedup filtering...

A Hadoop cluster is a collection of computers, known as nodes, that are networked together to perform these kinds of parallel computations on big data sets. Hadoop clusters consist of a network of connected master and slave nodes that utilize high availability, low-cost commodity hardware. Introduction to hadoop cluster Hadoop Cluster...