Walkover to Azure Cloud Storage

So Deepak, it's your turn now. Thank you everyone for listening to my presentation

This session will be available in Channel 9 this next week. Thank you

Thanks Rahat. So thanks everybody for having this our Tech Discussion webinar

webinar, I will try to interact, make it interactive as much as possible as well as my sole objective

is today after this session, we have fair idea about cloud storage, about blob storage

about data warehouse which we talked earlier and we came to know with the answers why we

need blob storage or why not we use another storage type. So that's my agenda

and thanks again. Today we talk about Azure Storage. As we know storage is the

most important part for any business right. If we have any business without

data or we can't afford to have data compromised in any condition. We can't

afford to have data still. We can't afford to have data having some network

compliances which is vulnerable to various regions. So we will cover all

that scenarios. So today we will discuss about how we can deliver the high scale

and low cost Azure storage data. We will do a live demo over here. I will share

sample code with you guys from which you can play around. That is

Visual Studio Code. You can download from my article from my website. We will look

our Azure storage tool also how we can have blob storage or unstructured data

how we can manage that how you know we can move ahead with that so that is we

are going to cover so first of all which I what I want to say like last time we

talk about the Azure Data Warehouse which is the structured way of storage

If I'm saying structured way you could say okay relational database maybe SQL

server. But today we will talk about blob storage which is another form of

storage which is unstructured database. If we talk about unstructured database probably things come into our mind what does that mean? That means if we have

data from satellite and we are storing it say live traffic data in Vancouver or

in Toronto or in Regina so that storage type would be unstoraged type. Another

Another storage type is having the log files from nuclear reactor where we are

updating it, appending it with infinite time, with infinite length. So that

would be the blob storage. Today we are not talking about structured storage which we did earlier but it would be the blob storage or

unstructured stories like log file, like image, like light telecast, recording etc

We will cover couple of scenarios to understand it better. We will cover the

key concept, what architecture it follows and we will going to have a demo, live

demo through Azure portal A, B by code, C by a tool. So the whole understanding

after this scenario after this session definitely we would have you know cover

about Azure storage in nitty-gritty and that that would be the objective of this

session. Okay so if I talk about current storage challenge, say being a

developer when I was developing an application 12 years back the main

challenge in front of me was to create a website having a database but I don't

know about what the scalability database required. After two years might currently I develop a web application having user base in Canada but after

three years if all the user base is shifted to the Europe then what will be

happen scalability being doing scalable in database that is really cumbersome task for any any developer or any team and that is also covered some risk that

cost us because we have to increase the infrastructure and without any

scalability limit business can't move forward. So if I would say all these

things are handled automatically by Azure Cloud Storage I think that would be a

great relief for any developer, any architect and from business perspective that is you know kind of business need. So that we are going to do with storage

and it adds the storage scalability limit. We don't have to worry about hard

drive, it is the automatically append. We don't have to worry about the risk

management nowadays what the threat we experience so that is also covered by

risk management and as far as we talk about the cost it is paper use so if you

are not using one PB of data or you are only using 100 GB of data then you will

be charged for 100 GB so that is the strength. So how the challenge can be

addressed by the storage challenge? We have limitless scalability, we have trust

because till now till today May 27th not a single incident has been reported of any threat compromised at cloud storage cloud economics and that gives to the business agility If we have limitless scalability we know if

today my application is at Canada or North America and tomorrow it's going to

be after a year in Europe or after that in Africa then definitely I have that

strength to expand my business without taking care of about the scalability. It

has trust it's paper use if I'm using 10 GB of data I will charge for 10 GB

not for 100 GB and that gives us the business agility that strength our

business so what is the Azure storage if we talk about Azure storage Azure

storage is the foundational building block of Azure like we talked about last

time we talked about Azure Data Warehouse where we store SQL, we have

data lake store but today we talk about Xbox, Skype, unstructured data. It is very

hyperscale, more than 120 trillion object. It's durable, it's secure, it's highly

available and it's open. We have APIs from which we can access the data, we can

play around that we can append it we can put it we can delete it we are going to

address and touch base those on further slides and we have strength of hybrid

stack also so that would be the azure storage azure storage services come into

two forms if we now we have fair about idea about azure storage where we talk

about that data storage or structured storage versus unstructured storage which is today we are covering so it's come into two form infrastructure as a service

where we have storage we have VM we have network or we have platform as a

service where we have existing frameworks say our web application and we

are using their service or compute power to have that so for Azure storage

service we have disk, we have files, couple of data which we need. Where a

platform as a service we have objects, tables and queues. So whatever our business

needs is, whatever the budget is as per our business scenario. If we are

appending our old application or versus if we are creating the architect of new

application we have all the strengths as IIS infrastructure as a service and

platform as a service. We can build on unified distributed storage system and

we can have various strengths like we can have local regional replication. We

can have the local replication of a data. If my data is at Regina that is in

North America, I can have three replicas, maybe in New York or maybe in that

local region itself. We can protect our data against this node-rec failures. We

don't have to worry about all that stuff, whereas global replicas system is we

have six replicas, two regions or three regions. For example, I want my data to

be stored in if my application or my business is at Canadian region and I want my data to be stored

in Europe because of because of I want different continent to mitigate the risk of disaster natural

disaster so that is the reason we have strength of GRS we can have our data replicate on any

location. Another benefit is if my data is at Canadian, if I have my business in

Canadian location or North American location and in future if my business is

more in Africa then I don't have to worry about it, we'll take care about that

It's protect against major regional disaster that is another requirement of business. Royal Bank of Canada can't afford to have their database in same

geographical region or any bank or any business can't afford in case of any

disaster if they lost data. What can be the repercussion? We can think about that

Another option is GRS plus read access to Scandry. We have Scandry

endpoints. So we talk about Azure storage. We can store it in local region, we can

store it into global region and we can have read access storage about, you know

on different regions with more strength. So it gives us more consistency

We always scrub our data to preserve from data integrity. So that's the

reason we are using Azure storage and now it's time to have you know one one

demo but prior to that I will cover another some basic points what has blob

storage object storage its store and some unstructured data unstructured data means app and web scale data big data from IOT Dix I was talking about

genomics etc. In genomics for one human being more than 13 million

required happened for that we definitely required unstructured data backup and archive for example a nuclear power station log file the data which is sent

by the satellite so definitely that is form of unstructured data and we don't

know what type of data how much it have to append so that is another feature we

have to we don't need to worry or we have strength to store data in PBs of

data it's durable we can use LRS and GRS global or locally replica system it is

highly available we can't afford or any business can't afford to lose data any

point of time or any downtime. So it has 99.99% of availability. It is

strongly consistent, dynamically scale up and bandwidth. It is cost-effective. We talk about cost effectiveness because it's pay per use. If you are using it

you are paying it It not about something that you have some plan where you are not using it you are going to pay So that is the Blob Storage Services which is in high demand because of data data integrity because of the

data required strength, the agility, scalability, security all that cover all

the things are covered by Azure Blob Storage which is unstructured data. For

For example YouTube images or videos that is a form of unstructured data

They are using storage. So that's the blob storage. Some basic concept which I touched through so that you have background before we dip

down into code or tools. But certainly I'm sure after this session you guys have a fair idea about blob storage

Why it is ideal for platform as a service? Why? Because it has limitless scale, globally accessible

I'm sitting over here, I'm on my vacations in Mexico and I have to change the GRS to LAS or change the security or change the container

I could do that from anywhere where I have internet access. It's not about I have to move to that data warehouse physically to make the

change. No, I can do it with tablet, I can do it with mobile if I have access to

internet. So that is the global accessibility. It's less dependent on a

physical location. It's cost-efficient. Scenarios for applications where we have to use it. We have live data repository, for example, we talk about say Chicago

traffic management. They are recording all the data of different streets of

Chicago to look over the security and traffic that is come under data

repository umbrella and that is unstructured data, active and deep archive. If we have to preserve the data for some nuclear test which is going on from last

12 years or some research then definitely storage blob storage will be

in use and data ytics. So what is Azure storage concept? Here is we we are

on Azure storage cloud we can have one person can have multiple subscriptions

and one subscription can have multiple account say if here is anybody of us we

can have multiple subscriptions subscription one two three and we can have various storage account what is the benefit what we will achieve we will

achieve we can keep the separation of concern we can have a different to

different storage account related to each other probably we are involving on

ten different activities so we can have ten storage account so it doesn't

restrict anybody to have one subscription versus one storage account Container is kind of folder, you could say our folder at system. Beneath that we

can have our data. In this case today we are talking about the blob data or blob

storage. So that's the reason. How does your storage work? If you have

to access if you want to share your data to me I'm sitting on different

geographical location I think everyone of us is on different geographical location how we could share the data we could share the data with the URL where

HTTP storage account would be the deeper classic for me or for you Carlos or

Dixar, Rahat anybody, blobcode.net, container name or blob name that is the

we can give the blob name we can have container we can have one container

under one container we can have multiple blobs so that is the storage URL

Type of blob, how many type of blob we have? We have three type of blobs one is

block block block block are you know we store the data in blocks that is more

commonly used 90% of our development scenario we are using the blocks a

storage for example documents we have one document for Regina chapter another

is for my Chicago tech talk another is for my Montreal tech talk so we have

different documents, images, we can have different images, video so maximum time

we have block blobs second time is append blob, append blob as name suggest

which is continuously increasing for example log files they are increasing day by day we can't break log files because of the consistency satellite is

sending the data and that is appending data, you know. So that is logging big data

that is append data. Page blob are kind of index on our book so we

name them okay 512 to any number so that is three type of blob. We look

our block block 90% of our time we will be around this append block can be when we are playing role

of like one of my friend who is working on international atomic research center he they

are using you know append blobs or page blobs as per business scenario for example banking system

probably they need it for particular brands so they have page blob. So block

names for example for us it may be the perk-blob.core-image. This is my

September agenda chapter. I present the same so yeah that's what can be

blob name for you it can be anything you can have your container name you can

have your name and there are certain rules we will look over when we will

create the blob when we you know do a demo account name can be 3 to 24

character lowercase only that why you couldn find DEE as capital because as it lower case only Container name is 3263 lower case only Blob name is 1024 case sensitive

And that's the some rules of blob names, blob structure, standard property

blob blob, page blob, append blob. We look over different these E tag and last modified

we have the blob where we maintain the concurrency when this blob has modified

or we look over the size in bytes about the blob. We can have up to 8 KB of unique name associated with it

And we can have up to 5 TB, 5 terabyte per blob

one blob we can have 5 terabytes. We can have n number of petabytes data that is not

you know restriction for us. So now it's time for us to have blob storage for a demo

and for demo I'm going to my azure portal let me open it my azure portal this is

my azure portal as Rahat has also told you if you don't have subscription in

Azure portal please create your subscription. Its subscription is $200 we get credited

So we can play around that in that amount. So we have some stories in stories for Blob Stories

We are doing one demo. Someone has just arrived. I want him to look over

What we are doing, we are creating demo for Blob storage. Here we are on storage and from storage we are creating the Blob file table queue

This is where we are creating our Blob storage. Let me give the name. We will give the webinar May 27th because everything

should be small. .co.window.net. Deployment model is the resource model or classic model. Whenever we have any doubt we can use this sign to

get the information. It's a resource manager for new application of maximum

time we are using it. Account type say blob storage is our account type, standard or

premium. For standard, we are maximum time using standard. The reason is

premium is bit expensive. If your business required very like you need very

good performance for example banking or financial transactions then probably you could use the premium. Replication, we look over three type of replication in

our presentation decks earlier. There are three types of replication we can say

locally redundant storage, geo-redundant storage, locally redundant storage say in in same geography, georedundant storage in different geography, read access

georedundant storage is you know with some extra features, extra strengths over there

So access tier, cool and hot. Cool when our data is not used frequently, we use cool

HOT if our data is used very frequently, we use HOT. So, for example, for finance transactions probably we would be on HOT, whereas for government website

where the number of users are not so high, then we could use COAL

Choosing an access tier, let you specify the access platform for data residing in Blob Storage

HOT access tier is idle for frequently accessed data. So when you create today this, definitely you can try to create different options

I'm using my MPN, Microsoft Partner Network subscription. You can have developer subscription or another subscription

Resource group, you can create existing Deepak resource for webinar, which we use for my webinars

Location we have I think I got on my website couple of questions about

location also. So we have different location I could choose Canada Central

this point of time. So we have created webinar May 27th Blob Storage which is

unstructured type of storage. It will create it. It has created it. It now

deployment in process. We have our deployment that's cool. Webinars, we use

standard, Canada Central, cool type and it's deploying it. Meanwhile it's deploying it I would also like to share if you guys want to do practical, want to

download code, this article is published on CsApp Corner. I am

sharing that URL at GoToMeeting also. You can have all the details from

there so that when you do if you want to increase your understanding or you want

to do practically implement it after a week or month or any time you will find

the details or you can visit deepercossit.com where you have you know

same resource same data over there you can send me questions and I'm happy to

help that. Meanwhile we were doing that I think we have created our first blob

storage and yes we are here