jobs

Why there is a mapreduce.jobtracker.address configuration on YARN?

折月煮酒 提交于 2019-12-01 12:04:43
YARN is the Hadoop second generation that not use the jobtracker daemon anymore, and substitute it with resource manager. But why, on mapred-site.xml hadoop 2 there is an mapreduce.jobtracker.address property? You are correct. In YARN, jobtracker no longer exists. So as part of client configuration you don't have to to specify the property mapreduce.jobtracker.address . In YARN, you should specify the property mapreduce.framework.name to yarn in the config file. Instead of setting up mapreduce.jotracker.address, you need to specify yarn.resourcemanager.address . setting yarn.resourcemanager

background task with an asp.net web application

只愿长相守 提交于 2019-12-01 11:35:17
问题 Is this the technique to run a background job every x minutes: http://msdn.microsoft.com/en-us/library/system.threading.threadpool.queueuserworkitem%28VS.71%29.aspx So would I load this in the global.asax? 回答1: I have written a couple of Blogs on background threads http://professionalaspnet.com/archive/2008/08/04/Creating-a-Background-Thread-to-Log-IP-Information.aspx http://professionalaspnet.com/archive/2009/09/21/Communication-With-a-Background-Thread-in-ASP.NET.aspx 回答2: Another method is

Parallel execution of stored procedures in job (SQL Server)

喜你入骨 提交于 2019-12-01 10:13:27
问题 Breif: I have five stored procedures and each of it have no dependencies. The identical stuff is that it pulling data from five different servers. We are just collating and feeding it to our server. Question: We have scheduled all these five in single job with 5 different steps. I want to execute it in parallel instead of sequential order. Extra: I can actually collate all five stored procs in to one if its possible to run it in parallel in sp level (if not possible in job level). Thanks 回答1:

Unexected results in Receive-Job

ⅰ亾dé卋堺 提交于 2019-12-01 07:07:49
问题 I noticed weird behavior when using jobs in PowerShell 5.0. Running job that returns PSObject , also returns some hashtable. Jobs that return strings, integers, etc work propertly. Running Start-Job { New-Object PSObject -Property @{ A = 1 } } | Receive-Job -Wait -AutoRemoveJob returns A : 1 RunspaceId : 6921e85f-301e-4e95-8e4b-c0882fc2085f PSSourceJobInstanceId : 2992ef77-5642-4eac-8617-f26449a87801 Running Start-Job { New-Object PSObject } | Receive-Job -Wait -AutoRemoveJob returns @

How to get attached files from an email, using Pentaho Kettle?

不羁岁月 提交于 2019-12-01 06:38:24
I'm stuck in a great problem. My task is to download some emails from a server using the IMAP protocol. This is accomplished by using the "get mails (POP3 / IMAP)" job entry, which downloads the emails, but in binary format. Files in binary format are .mail files containing sender, subject, body, and encoded attachment files. I need to obtain separate files, because I must realize some steps with these files as input. I've seen that there are third-party libraries or utilities to decode the .mail file and get the attachment file list. However, I want to do this process without any additional

Schedule SQL Job in a user configured time intervals everyday

落花浮王杯 提交于 2019-12-01 05:14:20
In my application (ASP.NET, C#), i need to run a stored procedure in a set of pre defined time interval(s) everyday. So that i created a sql job and scheduled the same. But the problem is, there is a option to create/modify this time intervals using the application and this will store the modified time intervals in a table. So i need to run the stored procedure in the user configured time intervals. Now i am doing the following steps to resolve the issue. Created a job to execute the stored procedure and scheduled for every 1 min. Inside the stored procedure i will check the current time (min)

Running Powershell scripts through SQL

送分小仙女□ 提交于 2019-12-01 03:46:44
问题 I have a script that runs Invoke-SQLCmd against a SQLServer called Server1. Data that is collected from that is passed along to another script that is fired off against Server2 and the results are inserted back into a table on Server 1. On every Invoke-SQLCmd I have used the -user -password with an account that has sa permissions on both systems. When i run the script from the command shell or from the Poershell ISE my data is inserted into the table and every thing works fine; When i run it

Jenkins delete builds older than latest 20 builds for all jobs

女生的网名这么多〃 提交于 2019-12-01 02:24:21
问题 I am in the process of cleaning up Jenkins (it was setup incorrectly) and I need to delete builds that are older than the latest 20 builds for every job. Is there any way to automate this using a script or something? I found many solutions to delete certain builds for specific jobs, but I can't seem to find anything for all jobs at once. Any help is much appreciated. 回答1: You can use the Jenkins Script Console to iterate through all jobs, get a list of the N most recent and perform some

Read .txt file from workspace groovy script in Jenkins

感情迁移 提交于 2019-12-01 01:47:50
I am new to Jenkins and to groovy scripting, I want to read a .txt file which is located in the workspace of one of the jobs. I am trying to do this way: myfile = Jenkins.instance.getJob('JobName').workspace.readFileFromWorkspace('file.txt'); But leads to the following error: groovy.lang.MissingMethodException: No signature of method: hudson.FilePath.readFileFromWorkspace() is applicable for argument types: (java.lang.String) values: [file.txt] Try this: file = new File("${Jenkins.instance.getJob('JobName').workspace}/file.txt").text I was struggling to make it work for the pom modules for a

How to get a handle to a JobObject without knowing its name?

五迷三道 提交于 2019-12-01 00:55:34
My application is running in a job. I want to get a Handle to this Jobobject using OpenJobObject so i can later use this handle. The problem is, that i don't know the jobs name, and with passing NULL to the Job name it gives error 87 ( The parameter is incorrect ) back. This is how i tried it: HANDLE handle = OpenJobObject( JOB_OBJECT_QUERY, FALSE, NULL ); if ( !handle ) printf( "\nError %d", GetLastError() ); else printf( "\nOK" ); I also found this on MSDN: An application cannot obtain a handle to the job object in which it is running unless it has the name of the job object. However, an