[ensembl-dev] VEP script using Fork

[Will McLaren]

Hi Duarte,

I've tested every fork number up to 30 without it crashing - what is
the error you're seeing when it crashes?

I'd be surprised if you got any significant benefit using any more
than 4, though, since there are overheads associated with creating
each fork.

You can get a feel for the performance by looking at the status output
that gives you the rate, something like:

2012-08-02 15:23:01 - Processed 16037 total variants (750 vars/sec,
927 vars/sec total)

Cheers

Will

On 3 August 2012 10:54, Duarte Molha <Duarte.Molha at ogt.co.uk> wrote:
> Hi
>
>
>
> I am trying out the new version and the fork does improve the performance.
>
>
>
> However the script crashes if I use more than 5 as the argument... since my
> server has many more cores than that I would like to try and see my much
> better it could run say forking at 16 (1 fork per core). Is this possible?
>
>
>
> Best regards,
>
>
>
> Duarte Molha
>
>
>
>
> _______________________________________________
> Dev mailing list    Dev at ensembl.org
> List admin (including subscribe/unsubscribe):
> http://lists.ensembl.org/mailman/listinfo/dev
> Ensembl Blog: http://www.ensembl.info/
>