Azure App Service is a PaaS offering for web-based applications in Microsoft Azure that which includes Auto Scaling. In this regard, it is comparable to AWS Elastic Beanstalk, which you have already seen before, in the section on AWS.
Azure App Service removes the need for a managing infrastructure; instead, you only need to be concerned about building and hosting your applications. For a full DevOps approach, it is advisable to use this PaaS service, if you want to work with Microsoft Azure.
For more information on Microsoft Azure App Service, check out https://docs.microsoft.com/en-us/azure/app-service/app-service-web-overview.