Synapse Workspace¶

https://microsoftlearning.github.io/mslearn-synapse/Instructions/Labs/01-Explore-Azure-Synapse.html

Create Azure Synapse Analytics workspace¶

Install

Install-Module Az.Resources  
Install-Module Az.Storage   #Get-AzStorageAccount, Set-AzStorageBlobContent
Install-Module Az.Sql

Install sqlcmd and bcp (bulk copy program):

Install-Module -Name SqlServer #does not help
curl https://packages.microsoft.com/keys/microsoft.asc | sudo apt-key add -
curl https://packages.microsoft.com/config/ubuntu/20.04/prod.list | sudo tee /etc/apt/sources.list.d/msprod.list
sudo apt update && sudo apt install mssql-tools unixodbc-dev

Set the sqlcmd and bcp path - see Linux/PowerShell/Creating a PowerShell profile.

Connect-AzAccount #login

Then run pwsh to register resource providers:

Microsoft.Synapse
Microsoft.Sql
Microsoft.Storage
Microsoft.Compute

And create:

Resource group
Synapse Analytics workspace
- Datalake storage account gen2
- Apache Spark pools
- Dedicated SQL pools
- Data Explorer pools
Pause the Data Explorer Pool
Grant permissions on the datalake storage account
Create the SQL database
Pause the SQL Pool

Synapse Workspace¶

Create Azure Synapse Analytics workspace¶

Injest data with a pipeline¶

Use a serverless SQL pool to analyze data¶

Use a Spark pool to analyze data¶

Use a dedicated SQL pool to query a data warehouse¶

Explore data with a Data Explorer pool¶