Azure Storage Service
Azure Storage Service
1
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
o Programming Queues
Azure SMB File Storage
o Common usage of File Storage
o Shares, Directory and File
o Managing Using Azure Portal
o Programming File Storage
Azure File Sync
Configure diagnostics, monitoring and analytics
o Capturing Metrics Data
o Analyzing Diagnostic Data
o Capturing Logs
o Retention Policies and Logging Levels
o Analyze Logs
o Enabling Monitoring
o Enabling Alerts
It offers four types of storage services, depending on the type of data that they are designed to store:
1. Blob Storage stores file data. A blob can be any type of text or binary data, such as a document, media file, or
application installer. Blob Storage is sometimes referred to as Object storage.
2
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
2. File Storage Similar to blobs, these provide storage for unstructured files, but they offer support for file
sharing in the same manner as traditional on-premises Windows file shares.
3. Table Storage stores partially structured datasets. Table storage is a NoSQL key-attribute data store, which
allows for rapid development and fast access to large quantities of data.
4. Queue Storage provides reliable messaging for workflow processing and for communication between
components of cloud services.
2. Account Kind: Storage (general purpose v1) / StorageV2 (general purpose v2) / Blob Storage
General-purpose v2 accounts: Basic storage account type for blobs, files, queues, and tables.
Recommended for most scenarios using Azure Storage.
3
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Block blob storage accounts: Blob-only storage accounts with premium performance characteristics.
Recommended for scenarios with high transactions rates, using smaller objects, or requiring consistently
low storage latency.
FileStorage storage accounts: Files-only storage accounts with premium performance characteristics.
Recommended for enterprise or high performance scale applications.
Note: Azure Premium File Shares storage accounts are specifically designed to support NFS
(Network File System) file shares. NFS is commonly used in Unix/Linux environments and
is ideal for scenarios that require NFS protocol compatibility.
3. Performance: Standard / Premium
Standard use HDD Drives and Premiun use SSD Drives
Premium is used for disks of VMs (Page Blobs)
Note that it is not possible to convert a Standard storage account to Premium storage account or vice versa.
4. Replication:
Locally redundant storage (LRS):
Replicates 3 times within a single data center in a single region where Storage Account is created.
Locally redundant storage (LRS) provides at least 99.999999999% (11 nines) durability of objects over a
given year.
The replicas are spread across UDs and FDs within one storage scale unit (A storage scale unit is a
collection of racks of storage nodes.)
A request returns successfully only once it has been written to all three replicas.
This architecture ensures your data is available if a hardware failure affects a single rack or when nodes
are upgraded during a service upgrade.
LRS is less expensive than GRS and also offers higher throughput.
For Premium Storage accounts – Either this or ZRS is the only option available.
4
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Once you have created your storage account and selected ZRS, you cannot convert it to use to any
other type of replication, or vice versa.
Consider ZRS for scenarios that require strong consistency, strong durability, and high availability even
if an outage or natural disaster renders a zonal data center unavailable.
What happens when a zone becomes unavailable? Your data is still accessible for both read and write
operations even if a zone becomes unavailable. Microsoft recommends that you continue to follow
practices for transient fault handling. These practices include implementing retry policies with
exponential back-off.
The Archive tier for Blob Storage isn't currently supported for ZRS accounts. Unmanaged disks don't
support ZRS or GZRS.
5
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
If your primary endpoint for the Blob service is myaccount.blob.core.windows.net, then your
secondary endpoint is myaccount-secondary.blob.core.windows.net. The access keys for your storage
account are the same for both the primary and secondary endpoints.
More Details: https://azure.microsoft.com/en-in/documentation/articles/storage-redundancy/
6
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
All storage accounts use a pricing model for blob storage based on the tier of each blob.
When using a storage account, the following billing considerations apply:
Storage costs: In addition to, the amount of data stored, the cost of storing data varies depending on the storage
tier. The per-gigabyte cost decreases as the tier gets cooler.
Data access costs: Data access charges increase as the tier gets cooler. For data in the cool and archive storage
tier, you are charged a per-gigabyte data access charge for reads.
Transaction costs: There is a per-transaction charge for all tiers that increases as the tier gets cooler.
Geo-Replication data transfer costs: This charge only applies to accounts with geo-replication configured,
including GRS and RA-GRS. Geo-replication data transfer incurs a per-gigabyte charge.
Outbound data transfer costs: Outbound data transfers (data that is transferred out of an Azure region) incur
billing for bandwidth usage on a per-gigabyte basis, consistent with general-purpose storage accounts.
Changing the storage tier: Changing the account storage tier from cool to hot incurs a charge equal to reading
all the data existing in the storage account. However, changing the account storage tier from hot to cool incurs
a charge equal to writing all the data into the cool tier (GPv2 accounts only).
7
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Blobs are binary large objects. The Blob service stores text and binary data.
Blob storage is also referred to as object storage.
You can use Blob storage to store content such as:
o Documents
o Social data such as photos, videos, music, and blogs
o Backups of files, computers, databases, and devices
o Images and text for web applications
o Configuration data for cloud applications
o Big data, such as logs and other large datasets
Every blob is organized into a container. Containers also provide a useful way to assign security policies to
groups of objects. A storage account can contain any number of containers, and a container can contain any
number of blobs, up to the 500 TB capacity limit of the storage account.
Creating BLOB Hierarchies: The blob service in Azure Storage is based on a flat storage scheme. This means that
creating a container one level below the root is the only true level of container. However, you can specify a
delimiter as part of the blob name to create your own virtual hierarchy. For example, you could create a blob
named /January/Reports.txt and /February/Reports.txt, and filter based on /January or /February in most
tools that support Azure Storage. Most third-party storage tools allow you to create folders within a container,
but they are actually being clever with the name of the blob itself.
8
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
http(s)://<storage account name>.blob.core.windows.net/<container>/<blob name>
Types of blobs:
1. Block blobs are optimized for streaming (sequential access) and for uploads and downloads, and are a good
choice for storing documents, media files, backups etc. Azure divides data into smaller blocks of up to (64KiB
to) 100 megabytes (MiB) in size, which subsequently upload or download in parallel. Individual block blobs
(file) can be up to 100 GiB in size. One blob can have max of 50,000 blocks.
2. Append blobs: Append blobs are similar to block blobs, but are optimized for append operations. This works
best with logging and auditing activities. Updating or deleting of existing blocks is not supported. Max block size
can be 4 MiB only.
3. Page blobs are optimized for random read/write operations and provide the ability to write to a range of
bytes in a blob. Blobs are accessed as pages, each of which is up to 512 bytes in size. Each Page blob can be up
to 8TB each. Is best suited for virtual machine disks (VHD).
Additional Topics
Snapshot
Versions
What is Lease
Metadata
Indexes
Soft Delete
Index vs Metadata
Only index tags are automatically indexed and made searchable by the native Blob Storage service. Metadata
can't be natively indexed or searched. You must use a separate service such as Azure Search.
Blob index tags have additional permissions for reading, filtering, and writing that are separate from the
underlying blob data.
Life cycle management filters can use index tags.
10
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
]
}
Azure Storage Explorer has many uses when it comes to managing your storage. See the following articles to learn
more. Also, check out the videos that follow this topic.
Connect to an Azure subscription: Manage storage resources that belong to your Azure subscription.
Work with local development storage: Manage local storage by using the Azure Storage Emulator.
Attach to external storage: Manage storage resources that belong to another Azure subscription or that are
under national Azure clouds by using the storage account's name, key, and endpoints.
Attach a storage account by using an SAS: Manage storage resources that belong to another Azure
subscription by using a shared access signature (SAS).
Attach a service by using an SAS: Manage a specific storage service (blob container, queue, or table) that
belongs to another Azure subscription by using an SAS.
Connect to an Azure Cosmos DB account by using a connection string: Manage Cosmos DB account by using
a connection string.
11
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
azcopy source destination [options]
What's new
Synchronize a file system to Azure Blob or vice versa. Ideal for incremental copy scenarios.
Supports Azure Data Lake Storage Gen2 APIs.
Supports copying an entire account (Blob service only) to another account.
Account to account copy is now using the new Put from URL APIs. No data transfer to the client is needed
which makes the transfer faster.
List/Remove files and blobs in a given path.
Supports wildcard patterns in a path as well as –include and –exclude flags.
Improved resiliency: every AzCopy instance will create a job order and a related log file. You can view and
restart previous jobs and resume failed jobs. AzCopy will also automatically retry a transfer after a failure.
Can copy from and to to AWS S3 stoage and Google Storage.
12
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Import and Export Service
When it comes to transferring very large amounts of data to or from the cloud you will want to consider using the
Azure Import/Export service. The Azure Import/Export Service allows you to:
Import to Azure Storage. Securely transfer large amounts of data to Azure Blob storage (block and page
blobs) and Azure Files by shipping disk drives to an Azure data center. In this case, you will be shipping hard
drives containing your data.
Export from Azure Storage. Transfer data from Azure storage to hard disk drives and ship to your on-premise
sites. Currently, you can only export Block blobs, Page blobs or Append blobs from Azure storage using this
service. Exporting Azure Files is not currently supported. In this case, you will be shipping empty hard drives.
✔️ Only 2.5" SSD or 2.5" or 3.5" SATA II or III internal HDD are supported for use with the Import/Export
service.
13
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
2. Determine data to be imported, number of drives you need, destination blob location for your data in Azure
storage.
3. Use the WAImportExport.EXE tool to copy data to disk drives. Encrypt the disk drives with BitLocker. This
creates a .jrn file.
4. Create an import job in your target storage account in Azure portal. Upload the drive journal files.
5. Provide the return address and carrier account number for shipping the drives back to you.
6. Ship the disk drives to the shipping address provided during job creation.
7. Update the delivery tracking number in the import job details and submit the import job.
8. The drives are received and processed at the Azure data center.
9. The drives are shipped using your carrier account to the return address provided in the import job.
14
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
1. Determine the data to be exported, number of drives you need, source blobs or container paths of your
data in Blob storage.
2. Create an export job in your source storage account in Azure portal.
3. Specify source blobs or container paths for the data to be exported.
4. Provide the return address and carrier account number for shipping the drives back to you.
5. Ship the disk drives to the shipping address provided during job creation.
6. Update the delivery tracking number in the export job details and submit the export job.
7. The drives are received and processed at the Azure data center.
8. The drives are encrypted with BitLocker and the keys are available via the Azure portal.
9. The drives are shipped using your carrier account to the return address provided in the import job.
Note:
Block blobs, Page blobs, and Append blobs will be exported. Export of Azure Files is not supported.
15
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
A shared access signature (SAS) is a URI that grants restricted access rights to Azure Storage resources. You can
provide a shared access signature to clients who should not be trusted with your storage account key but whom
you wish to delegate access to certain storage account resources. By distributing a shared access signature URI to
these clients, you grant them access to a resource for a specified period of time.
16
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
A shared access signature (SAS) is a token that can be appended to a URL that enables delegated access to a
storage resource.
Anyone who possesses the token can access the resource it points to with the permissions it specifies, for the
period of time that it is valid.
17
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Note: Stored access policies give you the option to revoke permissions without having to regenerate the storage
account access keys. Set the expiration on these to be a very long time (or infinite), and make sure that it is
regularly updated to move it further into the future.
Summary:
SAS Token
Account SAS
Always Ad-hoc
Same SAS token can be used for all services.
Service SAS
Ad-hoc / Stored Access Policy based
Specific to only one service at a time.
Container SAS token works for all blobs in that container
Blob SAS token is only for the blob for which it is generated
18
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Overview of Azure Active Directory for Blobs and Queues
• When a security principal attempts to access a blob or queue resource, the request must be authorized.
• The authentication step requires that an application request an OAuth 2.0 access token at runtime.
• The authorization step requires that one or more RBAC roles be assigned to the security principal.
Resource Scope
The levels at which you can scope access to Azure blob and queue resources:
• The subscription
• The resource group
• The storage account
• An individual container
• An individual queue
19
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Service EndPoint
• By default, storage accounts accept connections from clients on any network
• Virtual network service endpoints enable you to limit network access to Azure service resources. Access is
limited to just the virtual network subnets and IP addresses you specify.
Currently, Azure supports service endpoints to these services: Cosmos DB, Event Hub, Key Vault, SQL, and Storage
and few more…
Endpoints allow you to secure your critical Azure service resources to your virtual networks.
Walkthrough: To restrict access to Storage Account BLOB only from a VM in a given Subnet.
1. Create a virtual network
a. One subnet with disabled Service EndPoint
b. Another subnet with enabled service endpoint. Eg: Mcirosoft.Storage Service
20
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
21
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Problems:
a) The Storage Account PaaS is always used using it's Public IP and that may not be allowed in many corporate
networks as it would require explicit whitelisting of the Public IP in corporate Firewall.
b) Explicit need for adding every subnet (of vNET)
Note: Azure Storage File Service can be used for this demo.
Azure Private Link works on an approval call flow model wherein the Private Link service consumer can request a
connection to the service provider for consuming the service. The service provider can then decide whether to
allow the consumer to connect or not. Azure Private Link enables the service providers to manage the private
endpoint connection on their resources.
Traffic between your virtual network and the service travels the Microsoft backbone network. Exposing your
service to the public internet is no longer necessary.
22
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
KeyPoints
Block public access with the firewall.
Internal DNS resolves to private IP.
NSG's are not applied to the private endpoint.
Walkthrough: To Ensure that Azure PaaS service uses Private IP, if requested from vNET and public IP, if
requested from outside the vNET.
1. Create a Virtual Machine to test the private endpoint is working from it.
2. Create a Storage Account, Add Public Container and upoad a file.
3. Create a Private Endpoint: Search Private Link Create private endpoint Enter Basic details
1. Resource type = Microsoft.Storage/storageAccounts
2. Resource = <Storage Account>
3. Target sub-resource = blob
4. Select Virtual Network and Subnet in which it Private IP will be created.
5. Integrate with Private DNS zone = Yes and Either create or select DNS zone
6. Review + Create
7. This creates a Private DNS (<storageaccount>.blob.core.windows.net) name and NIC with Private IP
addres (10.0.1.4).
23
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
4. Test connectivity to private endpoint from outside the VNet (your local machine)
1. nslookup <storageaccount>.blob.core.windows.net
2. Note that the IP address listed is public IP
3. Try Access to Blob storage file from local machine and note that is accessible*.
5. *To restrict public access to storage account
1. Go to Storage Account Firewalls and virtual networks Select Selected Networks and don’t select
any network.
2. Try Access to Blob storage file from local machine and note that it is not accessible*.
6. Test connectivity to private endpoint from inside the VNet
1. RDP to VM
2. nslookup <storageaccount>.blob.core.windows.net
3. Note that the IP address listed is private IP (It’s the IP Address of the NIC created for Private
endpoint)
4. Try Acceess to Blob storage file from VM and it succeeds to connect.
Reference:
https://docs.microsoft.com/en-us/azure/private-link/create-private-link-service-portal
Private Link Service
Azure Private Link service is the reference to your own service that is powered by Azure Private Link. Your service
that is running behind Azure Standard Load Balancer can be enabled for Private Link access so that consumers to
your service can access it privately from their own VNets. Your customers can create a private endpoint inside their
VNet and map it to this service.
24
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Walkthrough:
Service Provider Steps:
1. Create a Source Virtual Network with Frontend-subnet.
2. Create a VM without any Public IP Address and in Frontend-subnet
3. Create a NAT Gateway and assign it to the New Subnet (NATGateway-subnet)
4. Create a Standard Load Balancer with VM added to its Backend pool.
5. Create a Private Link Service behind the standard load balancer.
Service Consumer Steps:
25
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
1. Create a Virtual Network with default subnet.
2. Create Private Endpoint maping to Private Link Service.
3. Find the IP address of Private Endpoint and submit the request
1. Destination-vnet
default-subnet
Destination-vm (No Public IP / Standard Public IP) - (Has a Website Hosted)
(For this VM, use Bastion and install IIS for Default Website)
2. Standard+Internal Loadbalancer
BackendPool -> Add Destination-vm
Frontend IP (Private IP)
HeathProbe (TCP,80)
LoadBalancerRule = Use all 3 parameters (BackendPool + Frontend IP + HealthProbe)
Note: This Loadbalancer is not accessiable outside the VNET.
Requirement: The LoadBalancer with Private IP should be accessible to Consumer-VM in Consumer-vnet (In a
different Tenant/Subscription/Region)
3. PrivateLinkService
Attach to Standard Load Balancer created in step2
4. Consumer-vnet
default-subnet
Consumer-vm (Can have Public IP for RDP)
5. PrivateEndPoint
Link it to PrivateLinkService
6. OPTIONAL: In Private DNS Zone = ARecord = Domain name mapping to Private IP of PrivateEndPoint
7. RDP to Consumer-vm and Browse using Domain name or Private IP of PrivateEndPoint
Reference:
Quickstart - Create a Private Link service by using the Azure portal | Microsoft Docs
26
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Privately access services on the Azure platform: Connect your virtual network to services in Azure without a
public IP address at the source or destination. Service providers can render their services in their own virtual
network and consumers can access those services in their local virtual network. The Private Link platform will
handle the connectivity between the consumer and services over the Azure backbone network.
On-premises and peered networks: Access services running in Azure from on-premises over ExpressRoute
private peering, VPN tunnels, and peered virtual networks using private endpoints. There's no need to
configure ExpressRoute Microsoft peering or traverse the internet to reach the service. Private Link provides a
secure way to migrate workloads to Azure.
Protection against data leakage: A private endpoint is mapped to an instance of a PaaS resource instead of
the entire service. Consumers can only connect to the specific resource. Access to any other resource in the
service is blocked. This mechanism provides protection against data leakage risks.
Global reach: Connect privately to services running in other regions. The consumer's virtual network could be
in region A and it can connect to services behind Private Link in region B.
Extend to your own services: Enable the same experience and functionality to render your service privately to
consumers in Azure. By placing your service behind a standard Azure Load Balancer, you can enable it for
Private Link. The consumer can then connect directly to your service using a private endpoint in their own
virtual network. You can manage the connection requests using an approval call flow. Azure Private Link works
for consumers and services belonging to different Azure Active Directory tenants.
Azure provides Content Delivery Network (CDN) functionality, which decreases the time it takes to download
web content by first distributing it across multiple locations around the world and then delivering it from the
location that is closest to the consumer of that content.
CDNs are typically used to deliver static content such as images, style sheets, documents, client-side scripts,
and HTML pages.
27
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
1. A user (Alice) requests a file (also called an asset) using a URL with a special domain name, such as
<endpointname>.azureedge.net. DNS routes the request to the best performing Point-of-Presence (POP)
location, which is usually the POP that is geographically closest to the user.
2. If the edge servers in the POP do not have the file in their cache, the edge server requests the file from the
origin.
3. The origin returns the file to the edge server, including optional HTTP headers describing the file's Time-to-Live
(TTL).
4. The edge server caches the file and returns the file to the original requestor (Alice). The file remains cached on
the edge server until the TTL expires. Azure CDN automatically applies a default TTL of seven days unless
you've set up caching rules in the Azure portal.
5. Additional users may then request the same file using that same URL and may also be directed to that same
POP.
6. If the TTL for the file hasn't expired, the edge server returns the file from the cache.
28
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
29
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
CDNs are intended for static content. Dynamic content needs to be refreshed constantly from the content
provider, minimizing and potentially eliminating any associated CDN benefits.
The CDN service is global and not bound to a location, however you must specify a resource group location
where the metadata associated with the CDN profile will reside. This location will not have any impact on the
runtime availability of your profile.
Walkthrough:
1. All Services CDN Profiles + Add
2. Name = DemoProfile
3. In the CDN profile blade, click + Endpoint.
4. In the Add an endpoint blade, specify the following:
o Name. This is a unique name in the azureedge.net Domain Name System (DNS) namespace.
o Origin type. This is Storage, Cloud service, Web app, or Custom origin.
o Origin hostname. This is the name of the host that represents the origin type that you selected. This can
be a name that displays automatically for Azure resources, an FQDN, or its corresponding IP address for
custom origins.
o Origin path. This allows you to specify a directory path to retrieve from the origin..
30
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
o Origin host header. This is designates the host header value that should be sent to the origin with each
request. This is useful if you host multiple virtual domains on a single target server.
o Protocol and origin port: HTTP with the default port 80 and HTTPS with the default port 443.
5. Click Add.
The metadata to control the TTL, and also the content type, is set on each blob as it is uploaded. The max-age
attribute is measured in seconds. In the following example, the TTL is set to 86400 seconds, or 1 day.
$blobProperties = @{ContentType="img/png"; CacheControl="public, max-age=86400" }
Set-AzureStorageBlobContent -File $_.FullName -Container $container -Context $context -Properties
$blobProperties
For every endpoint, you can configure a number of settings, such as:
CDN Profiles Select Profile Click on Endpoints Select Endpoint
Compression: Compress x` CDN to reduce size and improve performance. All listed MIME types will be
compressed when enabling the feature. Note that files are only compressed on the fly by the CDN if it is
served from CDN cache. Compressed by the origin can still be delivered compressed to the client without
being cached..
Cache rules: Query string caching behavior. This setting controls caching behavior, depending on whether the
request to the endpoint includes a query string or ignore query strings or ignore caching altogether.
Azure CDN caching rules are available only for Azure CDN Standard from Verizon and Azure CDN Standard
from Akamai.
Custom Caching Rules
The path can match a single file (e.g. '/pictures/city.png') or a folder (e.g. '/pictures/' or '/pictures/cities/').
When a folder is specified (i.e. with a trailing slash), the filter applies to all files and sub-folders under it
Geo-filtering: Create geo-filtering rules on specific paths on your endpoint to block or allow content in the
selected countries.
31
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
A blob stays in the CDN cache for a period known as the Time to Live (TTL), which by default is seven days.
Therefore, if users access this content frequently in a seven-day period, the CDN will offer a significant
performance gain. If users access this content every 10 days, CDN would provide no performance gains.
Register a custom domain for an Azure CDN endpoint using the intermediary cdnverify subdomain:
1. Navigate to your domain registrar's web site, Create a new CNAME record, and provide a subdomain alias that
includes the cdnverify subdomain.
For example, the subdomain that you specify will be in the format cdnverify.www or cdnverify.cdn. Then
provide the host name, which is your CDN endpoint, in the format cdnverify.<EndpointName>.azureedge.net.
Your DNS mapping should look like: cdnverify.www.consoto.com CNAME cdnverify.consoto.azureedge.net
2. Add custom domain name for CDN EndPoint. Azure will verify that the CNAME record exists for the cdnverify
domain name you have entered.
3. At this point, your custom domain has been verified by Azure, but traffic to your domain is not yet being
routed to your CDN endpoint. After waiting long enough to allow the custom domain settings to propagate to
the CDN edge nodes (90 minutes for Azure CDN from Verizon, 1-2 minutes for Azure CDN from Akamai),
return to your DNS registrar's web site and create another CNAME record that maps your subdomain to your
CDN endpoint. For example, specify the subdomain as www or cdn, and the hostname as
<EndpointName>.azureedge.net. With this step, the registration of your custom domain is complete.
32
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
4. Finally, you can delete the CNAME record you created using cdnverify, as it was necessary only as an
intermediary step.
33
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
blobs.contoso.com contosoblobs.blob.core.windows.net
CDN vs Frontdoor.
https://kishoregopalan.medium.com/azure-front-door-or-azure-cdn-what-solution-will-you-use-for-your-high-
availability-sites-be26bb34aee7
Azure Table Storage
Category(PKCategoryId, CategoryName, ...) - SQL Table
1, Furniture
2, Pets
3, Electronics
4, Computers
…more…
The Azure Table storage service stores large amounts of partially structured data offering high availability and
massively scalable storage.
The service is a NoSQL datastore which accepts authenticated calls from inside and outside the Azure cloud.
For today's Internet-based applications, NoSQL databases like Table storage offer a popular alternative to
traditional relational databases.
34
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
You can use the Table service to store and query huge sets of structured, non-relational data, and your tables will
scale as demand increases.
Table: A table is a collection of entities. Tables don't enforce a schema on entities, which means a single table
can contain entities that have different sets of properties. The number of tables that a storage account can
contain is limited only by the storage account capacity limit.
Entity: An entity is a set of properties, similar to a database row. An entity can be up to 1MB in size.
Properties: A property is a name-value pair. Each entity can include up to 252 custom properties to store up
to 1 MB of data. Each entity also has 3 system properties that specify a partition key (string upto 1KB in size),
a row key (string upto 1KB in size) and a timestamp. Entities with the same partition key can be queried
more quickly, and inserted/updated in atomic operations. One batch operation cannot have two entities with
different partition key. An entity's row key is its unique identifier within a partition.
35
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Using Visual Studio Server Explorer
1. Server Explorer … Select Windows Azure Storage Select and Expand Storage Account.
2. Expand to Tables Create Table…, Enter Name of Table
3. Select Table Right click View Table
4. Use the Editor to manage Table.
36
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Pricing Storage-optimized. Throughput-optimized.
SLAs 99.99% availability. 99.99% availability SLA for all single region accounts and all multi-
region accounts with relaxed consistency, and 99.999% read
availability on all multi-region database accounts Industry-
leading comprehensive SLAs on general availability.
37
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Every time it's received and not deleted, its Dequeuecount is incremented.
Azure File storage is a service that offers file shares in the cloud using the standard Server Message Block
(SMB) Protocol.
With Azure File storage, you can migrate legacy applications that rely on file shares to Azure quickly and
without costly rewrites.
Microsoft Azure virtual machines can share file data across application components via mounted shares, and
on-premises applications can access file data in a share via the File storage API.
Storage Account: All access to Azure Storage is done through a storage account.
Share: A File storage share is an SMB file share in Azure. All directories and files must be created in a parent
share. An account can contain an unlimited number of shares, and a share can store an unlimited number of
files, up to the 5 TB total capacity of the file share.
Directory: An optional hierarchy of directories.
File: A file in the share. A file may be up to 1 TB in size.
38
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
Max size of a File Share = 5TB
URL format: https://<storage account>.file.core.windows.net/<share>/<directory/directory>/<file>
The following example URL could be used to address one of the files in the diagram above:
http://samples.file.core.windows.net/logs/CustomLogs/Log1.txt
Use Azure File Sync to centralize your organization's file shares in Azure Files, while keeping the flexibility,
performance, and compatibility of an on-premises file server.
Azure File Sync transforms Windows Server into a quick cache of your Azure file share.
You can use any protocol that's available on Windows Server to access your data locally, including SMB, NFS,
and FTPS.
You can have as many caches as you need across the world.
39
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
40
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
1. Deploy the Storage Sync Service. The Storage Sync Service is the top-level Azure resource for Azure File Sync.
A distinct top-level resource from the storage account resource is required because the Storage Sync Service
can create sync relationships with multiple storage accounts via multiple sync groups. A subscription can have
multiple Storage Sync Service resources deployed.
2. Prepare Windows Server to use with Azure File Sync. For each server that you intend to use with Azure File
Sync, including server nodes in a Failover Cluster, you will need to configure the server. Preparation steps
include temporarily disabling Internet Explorer Enhanced Security and ensuring you have latest PowerShell
version.
3. Install the Azure File Sync Agent. The Azure File Sync agent is a downloadable package that enables Windows
Server to be synced with an Azure file share. The Azure File Sync agent installation package should install
relatively quickly. We recommend that you keep the default installation path and that you enable Microsoft
Update to keep Azure File Sync up to date.
4. Register Windows Server with Storage Sync Service. When the Azure File Sync agent installation is finished,
the Server Registration UI automatically opens. Registering Windows Server with a Storage Sync Service
establishes a trust relationship between your server (or cluster) and the Storage Sync Service. Registration
requires your Subscription ID, Resource Group, and Storage Sync Service (created in step one). A server (or
cluster) can be registered with only one Storage Sync Service at a time.
A Sync Group defines the sync topology for a set of files. Endpoints within a sync group are kept in sync with each
other. A sync group must contain at least one cloud endpoint, which represents an Azure file share created in your
storage account, and at least one server endpoint, which represents a path on a Windows Server.
41
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
✔️ As Azure File Sync is available in only few Regions: Eg: West US, remember that your storage account must be
located in one of the regions in which Azure File Sync is supported.
Walkthrough
1. Create Storage Account
a. Create File Share in Storage Account.
2. Create Azure File Sync Service
a. Azure Portal Create a Resource Azure File Sync
42
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)
Deccansoft Software Services Azure Storage Service
b. In File Sync Service Create Sync Group
i. Select Storage Account and File Share created in Step1
3. Register our On-Premise Server or local server
a. Create a Windows VM 2019 Server
b. RDP to VM, Ensure that Azure PowerShell Cmdlets are installed.
Install-Module AzureRM
Import-Module AzureRM
c. Go to Server Manager Local Server Turn Off IE Enanhanced Security
d. Open Browser Search Azure File Sync Agent Download Download and Install File Sync Agent
e. Complete the Registration process: SignIn to Azure Account Select the File Sync Service
Register
4. Azure Portal File Sync Group Sync Group Add server endpoint Path = C:\AzureFiles.
Registered server. The name of the server or cluster where you want to create the server endpoint.
Path. The Windows Server path to be synced as part of the sync group. The path should not be the root
volume.
Cloud Tiering. A switch to enable or disable cloud tiering.
Volume Free Space. The amount of free space to reserve on the volume on which the server endpoint is
located. For example, if volume free space is set to 50% on a volume that has a single server endpoint,
roughly half the amount of data is tiered to Azure Files.
5. RDP to VM and Note that the folder is created in that VM.
6. Dump some files in that folder and note in Portal that files are now present in Azure file share.
43
Deccansoft Software Services H.No: 153, A/4, Balamrai, Rasoolpura, Secunderabad-500003 TELANGANA, NDIA.
http://www.deccansoft.com | http://www.bestdotnettraining.com
Phone: +91 40 2784 1517 OR +91 8008327000 (INDIA)