Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I am installing a Sun Grid Engine environment and I have a scheduler limit that I can't quite figure out how to implement.

My users will create array jobs that have hundreds of sub-tasks. I would like to be able to limit those jobs to only running a set number of tasks at the same time, independent of other jobs. Like I might have one array job that I want to run 20 tasks at a time, and another I want to run 50 tasks at a time, and yet another that I'm fine running without limit. It seems like this ought to be doable, but I can't figure it out.

There's a max_aj_instances configuration option, but that appears to apply globally to all array jobs.

I can't see any way to use consumable resources, as I'd need a "complex attribute" that is per-job, and that feature doesn't seem to exist.

It didn't look like resource quotas would work, but now I'm not so sure of that. It says "A resource quota set defines a maximum resource quota for a particular job request", but it's unclear if an array job's sub-tasks' resource requests will be aggregated for the purposes of the resource quota. I'm going to play with this, but hopefully someone already knows outright.

share|improve this question
add comment

1 Answer

up vote 1 down vote accepted

http://gridengine.info/2009/12/02/throttling-execution-of-array-job-tasks

share|improve this answer
    
You could add a jsv-script that enforces a -tc value if users haven't added it or if user ask for to big -tc value. –  Jimmy Hedman Nov 24 '11 at 9:47
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.