azure
86 items tagged with "azure"
Articles
Debug - Azure Functions Flex Consumption Plan - Attach File Share via SMB
Azure CLI: RuntimeError: The content for this response was already consumed
When using Azure CLI az command to deploy Bicep or ARM templates to Azure, you may encounter the above issue. This article shows you how to find out the root cause.
Setup DuckLake with Azure Storage Account
This articles show you how to resolve DuckDB error when using azure extension: Not implemented Error: Writing to Azure containers is currently not supported. You will encounter similar error if you are trying to implement DuckDB with Azure Blob Storage.
Mount Azure File Share to Azure App Service or Azure Functions Linux Container Apps
This code snippet shows you how to mount Azure Storage file share as a local drive in a Linux container app hosted in Azure App Service or Azure Functions. Outline of the code The code snippet does the following: Create a storage account Create file service Create a file share Create an App Service resource with Linux container Mount the file share to the app For .NET 8 containers If you use .NET 8 images that runs without root permissions, please mount the file share to path under /home. Otherwise, you may encounter errors like the following when deploying to Azure: "message":"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.","details":[{"code":"DeploymentFailed","target":"/subscriptions/\\\/resourceGroups/\\\/providers/Microsoft.Resources/deployments/kontext-web","message":"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.","details":[{"code":"InternalServerError","message":"There was an unexpected InternalServerError. Please try again later. x-ms-correlation-request-id: \\\*"}
Azure Function App - Failed to start a new language worker for runtime: dotnet-isolated
Deploy Azure Function App with .NET 8 to Azure Container Apps via Bicep
Azure Function App can now be deployed into Azure Container Apps managed environment. This code snippet shows you how to deploy an Azure Function App created with .NET 8 (dotnet-isolated as runtime) into a managed environment of Azure Container Apps. The container source image is from GitHub (ghcr.io). You can also use any other container registry. Resources created This Bicep template creates the following resources: Blob Storage account Azure Log Analytics workspace Azure Application Insights Azure Container Apps managed environment Azure Function App Required credential You need to provide a container registry user name and password if you are using private registry. This template uses GitHub Packages.
Creating Azure Function App with .NET 8 - Bicep Example
.NET 8 preview 7 is now supported for Azure Functions Linux consumption plan when creating dotnet-isolated function app. This code snippet shows you how to create a Function App using .NET 8. The key part is to change linuxFxVersion to 'DOTNET-ISOLATED|8.0'.
HTTPS Link Generation for ASP.NET Core App hosted in Azure Container Apps
Retrieve Client IP Address in Azure Container Apps with HTTP Ingress
Use Bicep to deploy Azure Container Apps with a free managed certificate
Context A few weeks ago when I was migrating Kontext from Azure App Services to Azure Container Apps, there was no free managed certificate. To address that issue, I used Let's Encrypt to create a certificate for Kontext. This process will take me a few minutes every few months . Now good news is that free managed certificate is also in preview in Azure Container Apps. The following code snippet shows you how to do that in Bicep. Note: \* when I deploy using Bicep, my container app was already existing. This means the domain verification is already added to my Azure DNS zones. If you are building a new app using managed certificate, I would suggest you do it in two steps: Bicep code to create container app enivronment, container and DNS records (incl. A record that points to IP of your container app and/or asuid verification TXT record). And then update Bicep code to add managed certificate and custom domains. In custom domains, you can reference the managed certificate ID directly. And then deploy Bicep code again with delta changes. \* The container image is from GitHub (not Azure Container Registry) in the following example. Issues When I run the deployments, Azure throws out one interim error like the following (however the deployment itself was not failing): The client 'XXX' with object id 'XXX' does not have authorization to perform action 'Microsoft.App/locations/managedCertificateOperationStatuses/read' over scope '/subscriptions/XXX/providers/Microsoft.App/locations/Australia East/managedCertificateOperationStatuses/XXX' or the scope is invalid. If access was recently granted, please refresh your credentials. (Code: AuthorizationFailed) After I wait for about 10 minutes the deployment becomes successful as the following screenshot does: !2023061092538-image.png References Custom domain names and bring your own certificates in Azure Container Apps Microsoft.App managedEnvironments/managedCertificates 2022-11-01-preview
GitHub Actions: Update Azure Container Apps Environment Variables
GitHub Actions provides action azure/container-apps-deploy-action to deploy built container into Azure Container Apps. This action's attribute environmentVariables can be used to replace the existing variables. If you only want to update some variables, we can use Azure CLI commands. References https://github.com/Azure/container-apps-deploy-action
Error: Muliple files found matching pattern ./*.sql
Deploy Azure Automation Runbooks via GitHub Actions
This code snippet shows how to use deploy Azure Automation PowerShell runbooks using GitHub Actions workflow. Automation Runbooks can be used to run scripts regularly including PowerShell workflows, Python scripts, etc. If you have multiple scripts to deploy, you can create a PowerShell script file to deploy. The following assumptions are made: The PowerShell runbook script (myrunbook.ps1) is located in the specified folder (scripts/runbooks). The runbook is PowerShell type. GitHub Actions secrets are setup to use OIDC to authenticate with Azure. The resource will be deployed into automation account named myautomationaccount under resource group 'rg'.
Azure Bicep - Allow Azure services and resources to access this resource
Azure Bicep Deploy Error - The 'parameters.properties.storageAccountSubscriptionId' segment in the url is invalid.
Fix Azure CLI Installer Error on Windows
Azure App Service IIS Log Analytics using Pandas
Utilize HOME and TEMP/TMP Folders in Azure App Services
Azure.RequestFailedException: The value for one of the HTTP headers is not in the correct format
Regular Expression Replace (REGEXP_REPLACE) in SQL Server
Lucene.NET Exception on Azure - segments.* file not found in AzureDirectory
Could not get the latest source version for repository *** hosted on Azure Repos using ref ***
Execute Azure SQL Statements Periodically via Azure Automation
Modern Web Application - Azure App Service ASP.NET Core Logging to Blob Storage
Azure Automation Account Runbooks
Azure CLI - Get VM IP Address List
AZ-104 Microsoft Azure Administrator Preparation Guide
Azure PowerShell Runbook Error - Internet Explorer engine is not available
.NET 6 Azure Functions Isolated: An error occurred while loading required library hostpolicy.dll
Read Email from Microsoft 365 via Microsoft Graph API
In article Python: Send Email via Microsoft Graph API, I provided detailed steps to send email through msal package. In this article, I am going to show you how to read emails from Microsoft 365 via Microsoft Graph API.
Azure Functions Error - 'System.OutOfMemoryException' was thrown
APPLICATIONINSIGHTS_CONNECTION_STRING or APPINSIGHTS_INSTRUMENTATIONKEY is defined but the Application Insights Extension is not installed
Azure DevOps - Configure Web or Function App Settings
Azure Functions: Timeout value of 00:05:00 exceeded by function
Use Python Kernel in Azure Data Studio Notebook
Azure DevOps dotnet publish Task Fail for .NET 5 Projects
Azure Blob Storage - This request is not authorized to perform this operation.
Python: Send Email via Microsoft Graph API
Build Azure Functions V4 with .NET 6
Azure DevOps - Configure Connection Strings for Azure Function App
Use Azurite (Microsoft Azure Storage Emulator) for Development and Testing
Use Entity Framework in .NET 5 Azure Functions
Read Environment Variables in .NET Azure Functions
Fix .NET 5 Azure Functions Build Error on Azure DevOps
Resolve - Azure Function App Publish Specific Target Not Existing in VS2019
How to Create User for Azure SQL Database
Export CSV File from Azure SQL Databases
Create Virtual Network for Azure App Services and Azure SQL Database
EntityFramework Core Database Migration in Azure DevOps Pipeline
Configure Azure Blob Storage as Application Log Storage
Run .NET 5 on Azure App Services
Load Microsoft 365 SharePoint List Data in Python
Entity Framework Core Code-First - Generate Covering Index with Columns Included
Modern Web Application - Azure Blob Storage for Uploaded Files
With cloud platforms like Azure, we can totally separate user content storage from web application storage to decouple components from each other and to make the application easy to scale and deploy. This article provides detailed information with code snippets about how to use Azure server-less product Blob Storage and App Service to enable horizontally scalable web application for users to upload files (BLOBs).
Azure SQL Database Automated Backup Strategy
How to install and setup Let's Encrypt on Azure Web Apps
Access Artifact BuildNumber in Azure DevOps Release Pipeline
It might be useful to push artifact or build variables to your Azure websites environment variables in Release pipelines.
Debug PySpark Code in Visual Studio Code
Advanced analytics on big data with Azure - Tutorial
Setup Teradata in Microsoft Azure
This page provides the steps to create a Teradata database in Microsoft cloud computing platform Azure.
Retrieve Azure AppSettings and Connection String Settings in ASP.NET Core Apps
In ASP.NET Core, we can easily use user secrets to manage our password or credentials. This post will summarize the approaches we can use after the websites are deployed into Azure.
5 Minutes to Create a Linux VM in Microsoft Azure
SQL Azure 动手实践教程
SQL Azure 概览与总结
本文总结了SQL Azure特性。SQL Azure数据库是微软提供的云端数据库服务，其体系结构参考如下图。
Diagrams
AI based Chatbot with LLaMA Models and Microsoft Semantic Kernel
This diagram illustrates an idea of implementing an AI based chatbot for Kontext on Azure. It leverages open source frameworks and LLMs (large language models) to implement a RAG (retrieval augmented generation). The chatbot will get the domain specific information from Kontext search engine as context information and provided it into backend API service which leverages Microsoft Semantic Kernel to construct the question and send to LLM service to generate the answers and then sends back to frontend. Alternatives In the diagram, LLMs can be replaced by other models like Open AI services of Azure Open AI services or any other relevant language models. Microsoft Semantic Kernel can also be replaced with LangChain too. References microsoft/SemanticKernelCookBook: This is a Semantic Kernel's book for beginners (github.com) Llama2Chat | 🦜️🔗 Langchain SciSharp/LLamaSharp: Run local LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp. (github.com) blazorly/LangChain.NET (github.com)
Forwarded Headers for ASP.NET Core Apps on Azure Container Apps
This diagram shows a scenario that ASP.NET Core application is hosted in Azure Container Apps and listens on HTTP port 8080 while Azure Container Apps ingress is configured with HTTPS. The original request protocol HTTPS is lost but the forward header X-Forwarded-Proto has value HTTPS that can be used by ASP.NET Core applications to generate the right URL with HTTPS protocol.
Solution Diagram Example
Example application and analytics on Azure.
Kontext Architecture 2023 on Azure
This diagram shows how Kontext is designed and built with Azure and GitHub products. It only shows the core products used and some other products are not included in the diagram. For example, Azure Automation Account for batch data calculations and updates. Notes: Common Services are used by most of the layers. Azure Functions are commonly used for asynchronous actions. Azure Container Apps are used to host the ASP.NET Core application & APIs.
Azure Serverless Architecture for Web/Mobile Applications
This diagram shows you how to implement a serverless architecture on Azure. Reference Serverless web application - Azure Architecture Center | Microsoft Learn
Azure Static Website with Custom Domain via Azure Storage account and CDN
This diagram shows you how to setup a static website on Azure using Azure Storage account and Azure CDN. Azure Storage account supports Static website capability and also allows you to bind a custom domain to access the content. For HTTP only, you can just use built-in Azure Storage account capabilities; for HTTPS, we can have to use Azure Front Door or Azure CDN (classic) services. For HTTPS, we can add a custom domain for the Azure CDN endpoint. As part of that setup, we can also choose CDN managed certificate or our own certificate as the following screenshot shows: !2022092341926-image.png References Quickstart - Create an Azure CDN profile and endpoint | Microsoft Learn Integrate a static website with Azure CDN - Azure Storage | Microsoft Learn
Azure Cache Redis as Session Store for ASP.NET Core Application
When use Cookie authentication schema in ASP.NET core applications, session data by default is saved in client as Cookies. If the session data (incl. user claims) are big (more than 4090 characters), it can be split into multiple chunks. You can notice that via application identifier cookie: .AspNetCore.Cookies: chunks-2 .AspNetCore.CookiesC1: XXX .AspNetCore.CookiesC2: XXX Instead of storing session data in client cookies, we can also store the session data in any store that implements ITicketStore. It can be databases, memory cache or distributed memory cache like Redis. This diagram shows a simple solution of using Azure Cache Redis as session store. The following links can be referenced to implement a solution like this. References Cookie size and cookie authentication in ASP.NET Core - Honza’s Blarg (hajekj.net) ChunkingCookieManager Class (Microsoft.AspNetCore.Authentication.Cookies) | Microsoft Docs Session in ASP.NET Core | Microsoft Docs Matteo's Blog - Implementing a custom ITicketStore for ASP.NET Core Identity (ml-software.ch) Using Redis Cache for session data storage in ASP.NET Core - Joonas W's blog
.NET Full Text Search on Azure using Apache Lucene
This diagram shows how to use Apache Lucene to implement full text search engine for Azure App Service ASP.NET core websites. Apache Lucene is an open source framework to provide world search capabilities. It is the search core of both Apache Solr™ and Elasticsearch™. The framework provide core libraries for Java, Python (PyLucene) and .NET.
Azure Automation - Call Stored Procedure in Azure SQL Periodically
This diagram shows the idea of using Azure Automation PowerShell Workflow runbook to call a stored procedure or execute other T-SQL in a Azure SQL database. For Kontext, this mechanism is used to regularly update tag, user, site and other stats.
Process Automation Approaches on Azure
There are several typical ways to automate processes on Azure: Azure Automation Account runbooks (PowerShell or Python) Azure Functions (with triggers or schedules) Azure Logic App (Power Automate is built on top of it) Azure App Service WebJobs For differences, refer to this article: Choose the right integration and automation services in Azure. For data processes, you can use many other tools like Azure Data Factory, Databricks, etc. What other tools or products you use for automating your Azure processes? What are the other features that differentiate these products from each other? You can post a comment to share you ideas.
Modern Web Application on Azure
This diagram can be used as banner for modern web application on Azure series articles.
Azure App Service Logging Provider
This diagram shows how to use Azure Blob storage (append blob) as storage for Azure App service. Extension package Microsoft.Extensions.Logging.AzureAppServices is used.
Azure Virtual Network Example
This diagram shows an Azure Virtual network example that integrates Azure App services and Azure SQL database.
Azure Infrastructure as Code (IaC)
This diagram shows Infrastructure as Code tools for Azure: ARM (Azure Resource Manager) template Bicep template (covert to ARM template via Bicep CLI) Terraform References Azure Bicep playground
Streaming Big Data to Azure Synapse via Azure Data Factory
This diagram shows a typical solution to stream big data to Azure Synapse: Data produced are streamed into Azure Event Hubs. Data in Event Hubs are captured in Azure Blob Storage via Event Hubs Capture feature. Once data capture is complete, an event is sent to Event Grid. Event Grid forwards the event information (with blob file path) to Azure Factory Pipeline (i.e. Event Grid triggered pipeline). Azure Data Factory uses event data (blob path) as source. Azure Data Factory sinks data to Azure Synapse SQL data warehouse for analytics.
Streaming Big Data to Azure Synapse via Azure Functions
This diagram shows a typical solution to stream big data to Azure Synapse: Data produced are streamed into Azure Event Hubs. Data in Event Hubs are captured in Azure Blob Storage via Event Hubs Capture feature. Once data capture is complete, an event is sent to Event Grid. Event Grid forwards the event information (with blob file path) to Azure Functions App (i.e. Event Grid triggered Functions App). Azure Functions App uses event data (blob path) to read the data. Azure Functions App loads data to Azure Synapse SQL data warehouse for analytics.
Azure Event Grid, Event Hubs, Service Bus
Are you confused about the differences between Azure messaging services such as Event Grid, Event Hubs and Service Bus? This diagram summarizes some of the key features of these products to help you understand them easily. It's also important to understand the differences between events and messages. One key difference is that message publisher and consumer usually has established some contracts and when the message is delivered, the publisher usually expects certain response from the consumer.
Azure Automation Account - Runbooks
This diagram shows some of the key components in Azure Automation Account: Runbooks Schedule Connections Credentials Certificates
Azure Virtual Network Peering
Virtual network peering allows you to connect two or more virtual networks seamlessly. Azure supports two types of peering: Virtual network peering: Connect virtual networks within the same Azure region. Global virtual network peering: Connecting virtual networks across Azure regions. References Virtual network peering
Mount Azure Storage Volumes to Container Group
Azure Files can be mounted to container groups in Azure Container Instances or App Services. To avoid latency, it is good practice to place the application containers in the same region as file storage.
Azure Kubernetes Service Components
This diagram shows you the key components and concepts in a Azure Kubernetes Service (AKS) cluster. In AKS, nodes (virtual machines) of same configuration are groups into pools. A node is a virtual machine in the cluster. A deployment represents identical pods. It defines the number of pods replica to deploy. A pod represents a single instance of your application. Usually one pod has one container though one pod can have multiple containers.
Kontext Cloud Diagram Example
This diagram is created for testing purpose to validate whether the software can draw diagrams with Azure, GCP and AWS product SVG icons correctly.