Author Topic: Cloud Services  (Read 7831 times)

0 Members and 1 Guest are viewing this topic.

Offline kevindavis007

  • Hero Member
  • *****
  • Posts: 12,380
  • Gender: Male
Cloud Services
« on: September 07, 2016, 01:04:25 am »
Which cloud services do you prefer? Amazon Web Services, Azure, or Google Cloud?  Personally I prefer Amazon Web Services..
Join The Reagan Caucus: https://reagancaucus.org/

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #1 on: September 07, 2016, 02:16:02 am »
AWS is king, hands down. Better class of offerings, although I might give the API Gateway to Azure.

AWS Lambda is very cool.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline roamer_1

  • Hero Member
  • *****
  • Posts: 43,314
Re: Cloud Services
« Reply #2 on: September 07, 2016, 03:14:55 am »
Which cloud services do you prefer? Amazon Web Services, Azure, or Google Cloud?  Personally I prefer Amazon Web Services..

My own. All it takes is a Linux box sitting in the DMZ (or port-forwarded if you like) running the services you need... and a domain service to get around dynamic DNS (which most routers will take care of anymore, once you buy the service).

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #3 on: September 07, 2016, 04:23:28 am »
My own. All it takes is a Linux box sitting in the DMZ (or port-forwarded if you like) running the services you need... and a domain service to get around dynamic DNS (which most routers will take care of anymore, once you buy the service).

Can "your own" autoscale when you have a major web site running a promotion that causes traffic to jump by 200%? And then scale back automatically when traffic dies down?

No offense, but your answer is patently ridiculous. Cloud services exist for a reason. If you are trying to run "your own," that just means you are not running a major web-enabled enterprise at scale.

Moreover, cloud services are entirely disposable. Do you have a dozen hardcore, multi-tier new product development projects going at the same time, each requiring separate QA, UAT, and/or staging environments? Try managing that on physical hardware. I've been in an enterprise that DID try to manage it that way. You would wait *months* to get new environments spun up. On AWS, you can have the environments in days or even hours.

Finally, if you've ever deployed something to production that performs... differently... than in QA/load testing, but you can't roll back for business reasons, cloud computing gives you a massive advantage of throwing a sh!t ton of servers at the problem until you can track down the performance issue. The cost in these instances is often a pittance compared to the loss in business revenue associated with a rollback.

Sure, AWS is probably NOT the right solution if you are hosting some dentist's website, but if you are trying to run an enterprise at scale, and have not embraced cloud computing, get with the times. It's a tremendous leap forward.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline roamer_1

  • Hero Member
  • *****
  • Posts: 43,314
Re: Cloud Services
« Reply #4 on: September 07, 2016, 05:08:08 am »
No offense, but your answer is patently ridiculous. Cloud services exist for a reason. If you are trying to run "your own," that just means you are not running a major web-enabled enterprise at scale.


No one said anything about enterprise, or I would not have said a thing.
« Last Edit: September 07, 2016, 05:09:14 am by roamer_1 »

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #5 on: September 07, 2016, 11:12:40 am »
No one said anything about enterprise, or I would not have said a thing.


Well, in that case, no one said anything about physical servers on your own network, either. The question was about CLOUD services.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline Taxcontrol

  • Hero Member
  • *****
  • Posts: 651
  • Gender: Male
  • "Stupid should hurt" - Dad's wisdom
Re: Cloud Services
« Reply #6 on: September 07, 2016, 01:52:29 pm »
When speaking of cloud, the vendor list varies by what service you are looking to purchase.  If you are looking for Infrastructure, Azure is top dog.  Of course, there are others in this market space as well.  In the services space, it gets a tad more confusing.

If you are looking at storage, there are lots of options.  Here is a review that might be helpful - http://www.toptenreviews.com/services/web-hosting/best-cloud-services/

If you are looking for a development environment in the cloud, I would say that there is no real market leader yet, though IBM"s offering "Bluemix" is cloud development on top of a cloud infrastructure.  In some ways, it is THE environment to go to for dev-ops type of environment. Other services such as DR or BCP in cloud are even more of a startup environment.

I guess it all comes down to what you are looking for from your provider and evaluate against your needs.  It is still a very highly customized environment - at least from the offering perspective.

Oceander

  • Guest
Re: Cloud Services
« Reply #7 on: September 08, 2016, 12:26:31 am »
@roamer_1
@bolobaby
Let's not fight too much about clouds and roll-your-own solutions. 

Just for two cents' worth, my take on the comment was that for one's own needs one can often set up a system you have on your home network and then access it from elsewhere as if it as your own personal cloud.

Now, clearly, that isn't comparable to the commercial "clouds" that are available, but if you just need a little for yourself, and you trust your home ISP to not throttle in-coming traffic, then a roll-your-own probably works.

Offline kevindavis007

  • Hero Member
  • *****
  • Posts: 12,380
  • Gender: Male
Re: Cloud Services
« Reply #8 on: September 08, 2016, 12:28:26 am »
@roamer_1
@bolobaby
Let's not fight too much about clouds and roll-your-own solutions. 

Just for two cents' worth, my take on the comment was that for one's own needs one can often set up a system you have on your home network and then access it from elsewhere as if it as your own personal cloud.

Now, clearly, that isn't comparable to the commercial "clouds" that are available, but if you just need a little for yourself, and you trust your home ISP to not throttle in-coming traffic, then a roll-your-own probably works.


Agreed..
Join The Reagan Caucus: https://reagancaucus.org/

Offline Just_Victor

  • Hero Member
  • *****
  • Posts: 1,765
  • Gender: Male
Re: Cloud Services
« Reply #9 on: September 08, 2016, 01:55:38 pm »
@roamer_1
@bolobaby
Let's not fight too much about clouds and roll-your-own solutions. 

Just for two cents' worth, my take on the comment was that for one's own needs one can often set up a system you have on your home network and then access it from elsewhere as if it as your own personal cloud.

Now, clearly, that isn't comparable to the commercial "clouds" that are available, but if you just need a little for yourself, and you trust your home ISP to not throttle in-coming traffic, then a roll-your-own probably works.

The majority of the public aren't using cloud services for commercial enterprise solutions.  I know I just need the ability to back-up household computers to make sure I don't lose family photos, Quicken data files, favorite links, etc.  Designating two networked computers as back-up servers works fine for me.

Or maybe I'm the rare exception rather than the majority.  Hell, I don't know....

If all I want is a warm feeling, I should just wet my pants.

Offline Restored

  • TBR Advisory Committee
  • ***
  • Posts: 3,659
Re: Cloud Services
« Reply #10 on: September 08, 2016, 02:12:52 pm »
Never put anything "in the Cloud" that you don't want the world to see. Once it gets on the Cloud, you have lost control of it. It belongs to the box where it resides. Granted, you may not care that people see your ZIP, GPG or PGP encrypted file because they can't see what is in it. But remember, Truecrypt used to be safe.

I put things on the Cloud that I want to retrieve from another computer. If someone wants to see my Emmaus talk or my Sunday School lesson, have at it.
Countdown to Resignation

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #11 on: September 08, 2016, 04:34:23 pm »
Never put anything "in the Cloud" that you don't want the world to see. Once it gets on the Cloud, you have lost control of it. It belongs to the box where it resides. Granted, you may not care that people see your ZIP, GPG or PGP encrypted file because they can't see what is in it. But remember, Truecrypt used to be safe.

I put things on the Cloud that I want to retrieve from another computer. If someone wants to see my Emmaus talk or my Sunday School lesson, have at it.

So, I think you are mistaking the term "cloud services" in this context. We aren't talking dropbox here. We're talking virtual servers and services inside a VPN hosted by a major provider.

To be clear, the days of [one server]=[one physical box] are essentially over. Almost all companies now - even those not on the cloud - are managing virtual servers through some sort of hypervisor. As an IT professional who has been in the industry a long, long time, it's been fun to watch the progression from mainframe to client-server to distributed web apps to cloud services, with a few minor stops along the way.

Computing power is becoming increasingly commoditized. In may ways, this is actually a good thing. Amazon Lambda, for example, takes it even a step further, creating "server-less" computing solutions.

Cloud services are essential for any company that needs to control costs and scale in a flexible manner. Cloud services can be much more fault tolerant with redundant zones, which takes hardware and major network failures out of the question. Cloud services allow companies to offer SaaS solutions to customers with ease, and without lengthy ramp-up times.

Simply bear in mind that "cloud" in this context is not storage per se (although you could use storage solutions, especially around big data), but it's about computing power - exposing things like APIs to third parties, or providing a messaging backbone for your mobile app, or crunching massive data as part of a machine learning system on a periodic basis.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Oceander

  • Guest
Re: Cloud Services
« Reply #12 on: September 08, 2016, 10:37:22 pm »
@Restored
@bolobaby

Seems pretty clear to me that y'all are talking about two different things.

Offline Restored

  • TBR Advisory Committee
  • ***
  • Posts: 3,659
Re: Cloud Services
« Reply #13 on: September 08, 2016, 11:02:41 pm »
The Cloud refers to storage outside your machine, not web services. I work for a major tech university. We don't allow things to be stored outside the wire. That includes "the Cloud". The Cloud doesn't exist inside the wire. That's a NAS.
Countdown to Resignation

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #14 on: September 09, 2016, 12:04:00 am »
The Cloud refers to storage outside your machine, not web services. I work for a major tech university. We don't allow things to be stored outside the wire. That includes "the Cloud". The Cloud doesn't exist inside the wire. That's a NAS.

Incorrect. I'm an IT executive and I can tell you with 100% certainty that when someone asks your opinion of cloud services, as above, and even provides the additional context of AWS vs Azure, for example, they are not limiting themselves to storage, but virtual servers and services. If, for example, you do not know what an API gateway is, or how to use in-memory caching solutions to improve application performance, or how SNS can be used to manage and broadcast events, or even how you can use cloud-based HSMs to enforce security, you should take the time to educate yourself on these very important topics.

Start digging in here: https://aws.amazon.com/

Storage is just one part of cloud services. All tiers of a multi-tier application can exist in the cloud. And, once again, I'll bring up AWS Lambda just to underscore the point. Lambda allows you to fire off compute activity based on specific events. So, you could set up a text-based ordering system that monitors an SNS queue. When a new text order comes in, Lambda could fire off a series of cloud based web services that checks inventory, places the order, and puts an outbound "order complete" on another queue. That outbound message could be picked up be an EC2 instance for handling, which - if you understand cloud servers - may or may not have been instantiated 10 minutes ago, and may be terminated 10 minutes from now, never to be seen again.

If your major tech university is not teaching these concepts, they are failing their students. No offense, but they are.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline Weird Tolkienish Figure

  • Technical
  • *****
  • Posts: 18,133
Re: Cloud Services
« Reply #15 on: September 09, 2016, 12:50:07 pm »
AWS is good, but it's also a ripoff. Check out vps.net, where you can get a VPS for $5 a month in some of the cheaper suites.

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #16 on: September 09, 2016, 01:45:14 pm »
AWS is good, but it's also a ripoff. Check out vps.net, where you can get a VPS for $5 a month in some of the cheaper suites.

That's definitely a better price, but only for the VPS. AWS has a variety of services that are available OOTB, like RedShift for high volume data capture and parsing, which we used to store Segment.io web analytic events. You can't get that with just a VPS.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline Weird Tolkienish Figure

  • Technical
  • *****
  • Posts: 18,133
Re: Cloud Services
« Reply #17 on: September 09, 2016, 02:45:11 pm »
That's definitely a better price, but only for the VPS. AWS has a variety of services that are available OOTB, like RedShift for high volume data capture and parsing, which we used to store Segment.io web analytic events. You can't get that with just a VPS.

Right but then you're tied to some proprietary BS. I'm sure it works for you and that's fine.

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #18 on: September 09, 2016, 02:51:54 pm »
Right but then you're tied to some proprietary BS. I'm sure it works for you and that's fine.

Out of curiosity, what's the largest number of events you've had to handle at any given time, either service calls, analytic events, or page requests?
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Offline Weird Tolkienish Figure

  • Technical
  • *****
  • Posts: 18,133
Re: Cloud Services
« Reply #19 on: September 09, 2016, 03:17:30 pm »
Out of curiosity, what's the largest number of events you've had to handle at any given time, either service calls, analytic events, or page requests?

I do system administration for a company that performs research contracts for pharmacy companies. By "events" I'm not sure what you mean? I administer about 50 servers who each are constantly logging "events'.
« Last Edit: September 09, 2016, 03:18:15 pm by Weird Tolkienish Figure »

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #20 on: September 09, 2016, 04:27:58 pm »
I do system administration for a company that performs research contracts for pharmacy companies. By "events" I'm not sure what you mean? I administer about 50 servers who each are constantly logging "events'.

So, for example, let's say you worked for Amazon, the retail site side of the house.

1. Amazon obviously gets millions of people looking at their site each day, shopping for various items. Each rendering of a product page, search results, checkout page, writing reviews, help pages, etc would be a page request event.

2. Amazon is a data-driven company, so they log lots and lots of information about your visit. If you click an image to see the expanded view, they want to know about it. If you use the "calculate shipping" widget, which doesn't render a new page but handles the request through AJAX, they want to know. If you even scroll down to a certain point on a page, they may log an event (I don't know for sure, but I could check easily enough). All these events are web analytic events.

3. Amazon exposes product and shopping APIs to third parties in order to improve their funnel and affiliate sales. Each service call against these APIs would be an event.

That's the kind of thing I'm talking about. High volume, concurrent events, of which you may have little control over the rate of requests. So, if some new affiliate creates a site that hits your API waaaay more than expected, you need to be able to either scale quickly or throttle the affiliate requests. Or, if you come under DOS attack (or even just an unknown crawler), you need to be able to handle that. Or if someone runs a Superbowl ad for something that can be bought on your site, you want to be able to handle the sudden increase in traffic.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Oceander

  • Guest
Re: Cloud Services
« Reply #21 on: September 10, 2016, 09:06:59 pm »
Just as an FYI:  the forum is, in fact, considering a move to a cloud-based service like AWS after the "little" snafu today that crashed the forum for several hours.

Offline bolobaby

  • Hero Member
  • *****
  • Posts: 2,373
Re: Cloud Services
« Reply #22 on: September 11, 2016, 01:54:46 am »
Just drop logs in an S3 bucket or log to a db instance. If you rely on traditional app server logs stored to the machine, you will lose them when an instance is terminated.

It's the most common mistake people make when first moving to ephemeral servers.
How to lose credibility while posting:
1. Trump is never wrong.
2. Default to the most puerile emoticon you can find. This is especially useful when you can't win an argument on merits.
3. Be falsely ingratiating, completely but politely dismissive without talking to the points, and bring up Hillary whenever the conversation is really about conservatism.
4. When all else fails, remember rule #1 and #2. Emoticons are like the poor man's tweet!

Oceander

  • Guest
Re: Cloud Services
« Reply #23 on: September 11, 2016, 02:08:03 am »
Just drop logs in an S3 bucket or log to a db instance. If you rely on traditional app server logs stored to the machine, you will lose them when an instance is terminated.

It's the most common mistake people make when first moving to ephemeral servers.

I noticed that with AWS (I opened a free account to do some experimentation).  How robust are the instances?  If I have one running and it shuts down, how much do I lose?

Offline Taxcontrol

  • Hero Member
  • *****
  • Posts: 651
  • Gender: Male
  • "Stupid should hurt" - Dad's wisdom
Re: Cloud Services
« Reply #24 on: September 11, 2016, 02:12:04 am »
Just as an FYI:  the forum is, in fact, considering a move to a cloud-based service like AWS after the "little" snafu today that crashed the forum for several hours.

Oceander, just as a point of contention on cloud services, IaaS does NOT provide resiliency.  If you are trying to go to cloud for the purpose of resiliency, understand that often what is sold is rapid recovery of the OS only!  Your data, your configs, many times are up to you to detect and repair.