Category: Azure SQL Database
Azure SQL Database– Gaining the Azure Data Engineer Associate Certification
This product is on the other side of the cloud service spectrum when compared to SQL Server on Azure VMs. An Azure SQL Database (SQL DB) is a relational DBaaS that offers not only the outsourcing of network and hardware infrastructure, but also operating system and DBMS responsibilities. All you need to worry about is…
Read MoreAzure Key Vault – Gaining the Azure Data Engineer Associate Certification
It is unfortunately very common to store passwords and connection strings within application code. Sometimes they are stored in a configuration file along with the coded application. Even if the password or connection string is encrypted, it can still be compromised. This is because anyone with administrative access to the machine that decrypts the credential…
Read MoreBlob Storage – Gaining the Azure Data Engineer Associate Certification
If you need to store files such as JSON, XML, DOCX, MP3, PDF, or any other kind of file, then use Blob Storage. Blob Storage implements a flat namespace for organizing data, in contrast to the hierarchical namespace organization that comes with ADLS Gen2. Although you can create folders and place files within them when…
Read MoreAzure Data Lake Analytics – Gaining the Azure Data Engineer Associate Certification
Azure Data Lake Analytics is used to run on‐demand data analytic jobs in parallel. The parallelism is achieved using Microsoft Dryad, which can compute data represented in directed acyclic graphs (DAGs). A DAG is a model helpful in the calculation of the “traveling salesman” scenario, in which there can be sequential proposed directions that never…
Read MoreAzure Event Hubs – Gaining the Azure Data Engineer Associate Certification
Azure Event Hubs is an endpoint for ingesting data at high‐scale frequencies. There are numerous ways to move data into a datastore, such as by creating a connection to a database via code running on a website or within a client application. The problem with that approach is that databases typically have a limit on…
Read MoreACL and POSIX Security Model – Gaining the Azure Data Engineer Associate Certification
When you’re securing files and folders, the access permission level (aka Access ACL) is critical. The access permission level has to do with what actions a person or entity can perform on those files or folders. Table 1.5 describes those permissions. TABLE 1.5 File/folder access permission levels Permission File permission Directory permission Execute (X) No…
Read MoreAzure Data Lake Storage – Gaining the Azure Data Engineer Associate Certification
Azure Data Lake Storage (ADLS) is a fundamental piece of most enterprise data analytics solutions running on Azure. This product is optimized for Big Data analytics workloads. ADLS accomplishes this by providing storage capacity of up to multiple exabytes of data and supplying access to that data at a throughput of hundreds of gigabytes per…
Read More