Category: Comma‐Separated Values

Create an Azure SQL DB – CREATE DATABASE dbName; GO

FIGURE 2.3 The Select SQL Deployment Option blade 2. Select the subscriptions and resource group where you want the database to reside. Enter a database name (I used brainjammer). Under the Server drop‐down box, click the Create New link to create a database server. Enter the server name (I used csharpguitar), and enter a server…

Read More

Optimized Row Columnar – CREATE DATABASE dbName; GO

This file format is a columnar format used in the Hadoop ecosystem, like parquet files. Both ORC and parquet files are often referred to as self‐describing, which means the information that describes the data in the file is contained within the file itself. Metadata typically accompanies the file. For example, in Windows, when you right‐click…

Read More

Tags– Gaining the Azure Data Engineer Associate Certification

When you provision an Azure resource in the Azure portal, one common step is requesting tags (see Figure 1.30). This gives you the option to add a query‐able identifier to the resource. For example, you can mark it as production, test, or development, or perhaps identify a contact person for the given resource. Regardless, this…

Read More

Azure Functions– Gaining the Azure Data Engineer Associate Certification

An Azure Function is a FaaS, aka serverless cloud service, offering on Azure. This product is useful for event‐driven IT solutions, such as monitoring and processing messages that enter a messaging queue. The code that is executed is typically small, consisting of a single method or snippet of code. This product scales to the capacity…

Read More

Azure Networking – Gaining the Azure Data Engineer Associate Certification

The networking capabilities in Azure are in most cases abstracted away from customers. The Azure network capabilities that link the Azure resources within a datacenter and between datacenters is owned, operated, and administrated by Microsoft. However, there are some networking products and features that let customers use and configure virtual aspects of the Azure infrastructure…

Read More

Variety – CREATE DATABASE dbName; GO

Data comes not only in different formats but also from different sources. The kind of data shared and stored on the Usenet was typically text, but as usage progressed, the Internet needed to be able to share many different types of files. For example, Amazon needed to show pictures of their products. Pictures are typically…

Read More

Multifactor Authentication – Gaining the Azure Data Engineer Associate Certification

Using only user IDs and passwords to protect a resource is no longer considered secure. People have a habit of using the same set of credentials on numerous locations, so if one location is compromised, then all of them are. This is where multifactor authentication (MFA) can help. User IDs and passwords are something a…

Read More

Azure Security– Gaining the Azure Data Engineer Associate Certification

Security is the most important aspect of IT. Networks, compute machines, data storage, and so on are important, but a data breach is almost, if not worse, than losing all your data. Knowing about the security products, features, and services that exist on Azure is an absolute must. Although your job as an Azure data…

Read More

Other Products– Gaining the Azure Data Engineer Associate Certification

Here are some additional storage products that may be included on the exam. Even if they do not appear on the exam, it is good practice to know most of the Azure products, what they do, and why you would use them. Azure Data Explorer Azure Data Explorer (ADE) has been referred to often as…

Read More

Apache Cassandra– Gaining the Azure Data Engineer Associate Certification

If you have an on‐premises NoSQL Cassandra database and want to migrate to the Azure platform, choose this service. When you migrate to Azure, you no longer need to manage nodes, clusters, or the OS. All of that is outsourced to Azure. Data is queried using the Cassandra Query Language (CQL), and you can use…

Read More