kudu

Azure WebJobs SDK ServiceBus connection string 'AzureWebJobsAzureSBConnection' is missing or empty

放肆的年华 提交于 2019-12-07 03:01:08
问题 I created an Azure Function App in Visual Studio 2015. The App has a trigger for service bus queues. The app works perfectly when I run it locally. It is able to read the data from the Service Bus queue (configured via a variable named AzureSBConnection) and log it in my database. But it gives me the following error when deployed in Azure: Function ($ServiceBusQueueTriggerFunction) Error: Microsoft.Azure.WebJobs.Host: Error indexing method 'Functions.ServiceBusQueueTriggerFunction'. Microsoft

Kudu与Impala在字符串处理上与其他DB的迥异

放肆的年华 提交于 2019-12-06 11:42:44
Kudu的时间戳类型,在Impala建表上用的是timestamp, 有2个与众不同的地方。 1. 在Kudu里它存的时间戳是纳秒级别,所以你普通的时间戳存进去需要*1000。 2. 另外,Kudu的时间戳里面存的是,UTC时间。所以存进去的时间需要自己转换时区。 2. Impala在读取时间戳的时候,会根据配置项,使用系统的本地时区。 配置了如下: -use_local_tz_for_unix_timestamp_conversions 从而导致数据加载异常。建议有条件的同学,使用字符串替代时间戳。 来源: https://my.oschina.net/dacoolbaby/blog/3137199

Azure websites with .NET 4.5.2

99封情书 提交于 2019-12-06 09:32:01
According to this semi-official answer here, Azure websites now supports .NET 4.5.2: https://stackoverflow.com/a/23554969/68231 However, when I visit the Kudu debug console, it doesn't show that .NET 4.5.2 is installed: And indeed, when I try to push out a website targeted to .NET 4.5.2, Kudu refuses to build and deploy the website in question, with errors like this: Areas\Integration\Controllers\TwitterController.cs(18,31): error CS0012: The type 'System.Object' is defined in an assembly that is not referenced. You must add a reference to assembly 'System.Runtime, Version=4.0.0.0, Culture

Azure webapp node.js app not starting

旧城冷巷雨未停 提交于 2019-12-06 04:10:33
问题 I'm trying to deploy a very simple express.js app on Azure webapp. The deployment log shows the that the deployment passes correctly but the app doesn't start. Checking the kudu process explorer shows that indeed the node.js process is not running On the other hand I don't see any application logs nor any indication that the app even started. Is there a way to see what happened when the nodeiis tried to start the app? 回答1: Azure WebApp for node.js is running via iisnode as a native IIS module

Kudu与Impala在字符串处理上与其他DB的迥异

生来就可爱ヽ(ⅴ<●) 提交于 2019-12-05 09:33:02
Kudu的时间戳类型,在Impala建表上用的是timestamp, 有2个与众不同的地方。 1. 在Kudu里它存的时间戳是纳秒级别,所以你普通的时间戳存进去需要*1000。 2. 另外,Kudu的时间戳里面存的是,UTC时间。所以存进去的时间需要自己转换时区。 2. Impala在读取时间戳的时候,会根据配置项,使用系统的本地时区。 配置了如下: -use_local_tz_for_unix_timestamp_conversions 从而导致数据加载异常。建议有条件的同学,使用字符串替代时间戳。 来源: oschina 链接: https://my.oschina.net/dacoolbaby/blog/3137199

Kudu与Impala在字符串处理上与其他DB的迥异

两盒软妹~` 提交于 2019-12-05 09:31:41
Kudu的时间戳类型,在Impala建表上用的是timestamp, 有2个与众不同的地方。 1. 在Kudu里它存的时间戳是纳秒级别,所以你普通的时间戳存进去需要*1000。 2. 另外,Kudu的时间戳里面存的是,UTC时间。所以存进去的时间需要自己转换时区。 2. Impala在读取时间戳的时候,会根据配置项,使用系统的本地时区。 配置了如下: -use_local_tz_for_unix_timestamp_conversions 从而导致数据加载异常。建议有条件的同学,使用字符串替代时间戳。 来源: oschina 链接: https://my.oschina.net/dacoolbaby/blog/3137199

Deploy to Azure Web App from Multiple Repositories

纵饮孤独 提交于 2019-12-05 06:53:58
问题 Looking for a way to deploy to an azure web app from 3 separate github repositories. One of the repositories is the main website, the other two are common libraries used by other projects. We want the deployment to pull down from all three repositories into an artifact directory, run msbuild and copy over the artifacts to wwwroot. I am assuming i will need a custom .deployment file along with a kudu batch file. But I can't find any examples on how to pull down from multiple github

Azure-functions: Can environment variables be used in function.json?

不羁的心 提交于 2019-12-05 02:36:41
I'm currently using the git push deployment option to deploy a few copies of an azure-function. The function's function.json file has multiple "connection" entries linking to different storage accounts (i.e. for a blob trigger & table output). In different copies of the deployed function I'd like to connect to different storage accounts. Is there any special syntax that can be used in function.json to populate the "connection" string from an environment variable? I guess an alternative would be to edit function.json as part of a custom kudu step, but environment variables seems more consistent

Azure webapp node.js app not starting

拟墨画扇 提交于 2019-12-04 12:04:26
I'm trying to deploy a very simple express.js app on Azure webapp. The deployment log shows the that the deployment passes correctly but the app doesn't start. Checking the kudu process explorer shows that indeed the node.js process is not running On the other hand I don't see any application logs nor any indication that the app even started. Is there a way to see what happened when the nodeiis tried to start the app? Azure WebApp for node.js is running via iisnode as a native IIS module that allows hosting in IIS on Windows. Please see the document https://blogs.msdn.microsoft.com

使用Apache Kudu和Impala实现存储分层

萝らか妹 提交于 2019-12-04 06:55:16
当为应用程序的数据选择一个存储系统时,我们通常会选择一个最适合我们业务场景的存储系统。对于快速更新和实时分析工作较多的场景,我们可能希望使用 Apache Kudu ,但是对于低成本的大规模可伸缩性场景,我们可能希望使用 HDFS 。因此,需要一种解决方案使我们能够利用多个存储系统的最佳特性。本文介绍了如何使用 Apache Impala 的滑动窗口模式,操作存储在 Apache Kudu 和 Apache HDFS 中的数据,使用此模式,我们可以以对用户透明的方式获得多个存储层的所有优点。 Apache Kudu 旨在快速分析、快速变化的数据。 Kudu 提供快速插入/更新和高效列扫描的组合,以在单个存储层上实现多个实时分析工作负载。因此, Kudu 非常适合作为存储需要实时查询的数据的仓库。此外, Kudu 支持实时更新和删除行,以支持延迟到达的数据和数据更正。 Apache HDFS 旨在以低成本实现无限的可扩展性。它针对数据不可变的面向批处理的场景进行了优化,与 Apache Parquet 文件格式配合使用时,可以以极高的吞吐量和效率访问结构化数据。 对于数据小且不断变化的情况,如维度表,通常将所有数据保存在 Kudu 中。当数据符合 Kudu 的 扩展限制 并且可以从 Kudu 的特性中受益时,在 Kudu 中保留大表是很常见的。如果数据量大