Latest Posts
Google Professional Data Engineer – TensorFlow and Machine Learning part 1
Introducing Machine Learning Here’s a question I’d like us all to think about as we go through the contents of this video. How would you recognize a machine learning based system if you saw one? So let’s say you were shown a piece of software or a system. How would you know whether it makes use of machine learning or not? What are the defining characteristics of a machine learning based system? Hello and welcome to this module on understanding the foundations of TensorFlow. In this module, we are going…
Google Professional Data Engineer – Ops and Security part 4
Lab: Cloud IAM In this lab, we will be using enduser and service accounts to see how modifying their privileges affects what they’re able to do within Gcp. To start with, let’s take a look at a couple of the end user accounts. The first one is of the user Vitaskrinivasan, who is a project owner. The second one is that of Judy Raj, whose permissions we will be modifying and then seeing how that affects her access. So once we log in as Judy, we will see that she…
Google Professional Data Engineer – Ops and Security part 3
Cloud Endpoints Here is a question which I’d like us to ponder over while we go through the contents of this video. The extensible service Proxy this is an important part of exposing APIs via cloud Endpoints. The question is, does the extensible service proxy always sit on the same Vpc, on the same virtual private cloud as the code that you are exposing as an endpoint? Think about about it and we’ll get back to it. Let’s wrap up this section on ops in the Google Cloud environment with…
Google Professional Data Engineer – Ops and Security part 2
Lab: Stackdriver Error Reporting and Debugging In this lab, we will be using Stackdriver for error reporting and debugging. We will first be launching a simple Google App Engine application and then introduce an error in that application. We will then use Stackdriver in order to view the errors and then do some debugging to identify the error and eventually fix it. Let us start off off though by creating this Google App Engine application. So we bring up the cloud shell and then we create a directory called App…
Google Professional Data Engineer – Ops and Security part 1
StackDriver Here is a question that I’d like us to keep in mind as we go through the material in this video. Only Gcp projects and resources can be monitored using Gcp Stackdriver monitoring service. Is this statement true or false? We’ll come back to the answer to this question at the end of the video. Hello and welcome to this module which has to do with operations on the Google Cloud platform. A lot of the stuff that we are going to discuss in this module will have to…
Google Professional Data Engineer – Managed Instance Groups and Load Balancing part 5
Autoscalers A discussion of auto scaling goes hand in hand along with load balancing. Now that we’ve understood the different kinds of load balancers that Google Cloud platform has to offer, let’s now discuss how auto scaling works. When we set up external global load balancers, we often use instance groups of instance groups. The one we prefer is the managed instance instance group because managed instance groups have the ability to scale instances based on changes in traffic. So managed instance groups can automatically add more machines as the…
Google Professional Data Engineer – Managed Instance Groups and Load Balancing part 4
SSL Proxy and TCP Proxy Load Balancing We’ve just seen in a lot of detail how the global external Http Https load balancing works. Let’s move on to the SSL proxy load balancing and see how the Google Cloud platform implements this. The SSL proxy load balancing sits at the sessions layer of the OSI stack, so it’s below the application layer. Remember, the rule of thumb is if you can do application layer load balancing, you should not prefer to do SSL or PCP load balancing. But if your…
Google Professional Data Engineer – Managed Instance Groups and Load Balancing part 3
Load Distribution and Firewall Rules Let’s now see how the Load Balancer distributes load across the various back end services and the corresponding backends every back end is configured with a balancing mode and this is the metric that the Load Balancer uses to determine how loaded a particular backend is and how much capacity it actually has. The balancing mode that we use is CPU Utilization or Request per second per instance you can configure the balancing mode to be either of these based on your requirement, you can…
Google Professional Data Engineer – Managed Instance Groups and Load Balancing part 2
Forwarding Rules Target Proxy and Url Maps In the last lecture, we saw a quick overview of all the components that make up an Http Https load balancer. In this lecture and in subsequent lectures, we look at each of these components in some detail. We’ll start off by looking at the global forwarding rule. These are rules that you configure on the Cloud platform in order to determine where particular a traffic will be sent. Every forwarding rule matches a particular IP address protocol, and optionally, you can choose…
Google Professional Data Engineer – Managed Instance Groups and Load Balancing part 1
Managed and Unmanaged Instance Groups In this section we’ll discuss managed instance groups and load balancing. Managed instance groups are basically a group of identical VMs that are generated using something called an instance template and this group of VMs can be scaled automatically to meet increasing traffic requirements. This is why managed instance groups and load balancing typically go together. Load balancing involves distributing requests across instances so that requests go to those instances which have the capacity to handle them. Managed instance groups are a pool of similar…