Yafu 16t

Message boards : Number crunching : Yafu 16t
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
fzs600

Send message
Joined: 2 Sep 11
Posts: 7
Credit: 18,104,086
RAC: 21,578
France
Message 861 - Posted: 13 Jul 2016, 12:47:27 UTC

Hello

Therefore I will never be sent an YAFU-16t Version

What should I do to receive?

thank you
ID: 861 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile yoyo_rkn
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 22 Aug 11
Posts: 723
Credit: 16,445,605
RAC: 86
Germany
Message 862 - Posted: 13 Jul 2016, 16:19:01 UTC

You should have at least 16 cores.
ID: 862 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
fzs600

Send message
Joined: 2 Sep 11
Posts: 7
Credit: 18,104,086
RAC: 21,578
France
Message 863 - Posted: 13 Jul 2016, 18:39:17 UTC - in response to Message 862.  

You should have at least 16 cores.

OK.
thank you
ID: 863 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile firstomega

Send message
Joined: 19 Apr 12
Posts: 1
Credit: 10,982,056
RAC: 4,451
Germany
Message 876 - Posted: 14 Sep 2016, 22:33:50 UTC

You can also run it with fewer cores, but it is not really suitable when also running other CPU pojects.

You need to change cc_config.xml to 16 cores with the following:
<options>
<ncpus>16</ncpus>
</options>

Then you must create an app_config.xml file in the projects folder of yafu with the following:
<app_config>
        <app_version>
                <app_name>yafu-16t</app_name>
                <plan_class>16t</plan_class>
                <avg_ncpus>16</avg_ncpus>
                <cmdline>--nthreads 8</cmdline>
        </app_version>
</app_config>

The 16 is what BOINC will think it uses and 8 are the real cores of the machine.
You have also to realise that the deadline may be to short when using not enough cores.
ID: 876 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
scole of TSBT

Send message
Joined: 25 Sep 14
Posts: 2
Credit: 82,665,796
RAC: 355
Anguilla
Message 879 - Posted: 14 Oct 2016, 12:12:08 UTC
Last modified: 14 Oct 2016, 12:39:11 UTC

EDIT: Never mind. The system running the 16t WU appears to be using 16 cores now.
ID: 879 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 904 - Posted: 15 Nov 2016, 21:29:09 UTC
Last modified: 15 Nov 2016, 21:30:25 UTC

My two 16t work units are using just a single core each.
I did tell BOINC that I had 16 cores but in a cc_config.xml file but this made no difference.
I have just added the app_config.xml file posted above.

However I am unable to restart BOINC Client at this stage to make it read the file due to me running a QMC work unit. Despite it having checkpointing, this appears to not be working as it will start from 0.00 if I stop BOINC for any reason. It is currently at 33 hours with around 50 still to go so I will have to wait.

The yafu work units also went back to 0.00 along with the QMC WU when my PSU gave a loud POP and started issuing smoke 2 days ago.
They are also at 33 hours and about a quarter done.

Conan
ID: 904 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 906 - Posted: 16 Nov 2016, 1:08:48 UTC - in response to Message 904.  

My two 16t work units are using just a single core each.
I did tell BOINC that I had 16 cores but in a cc_config.xml file but this made no difference.
I have just added the app_config.xml file posted above.

However I am unable to restart BOINC Client at this stage to make it read the file due to me running a QMC work unit. Despite it having checkpointing, this appears to not be working as it will start from 0.00 if I stop BOINC for any reason. It is currently at 33 hours with around 50 still to go so I will have to wait.

The yafu work units also went back to 0.00 along with the QMC WU when my PSU gave a loud POP and started issuing smoke 2 days ago.
They are also at 33 hours and about a quarter done.

Conan


Well that QMC job was telling fibs, it said it was at 33% but it was not, when it passed 34 hours run time it moved to 1% completed.
With that first checkpoint I have been able to restart BOINC Client and it has read the app_config.xml from firstomega and is now running multiple cores as it should of been doing in the first place.
After 21 min 11 sec it has moved to 0.312% completed, so we will see how it goes (it restarted again from 0.00 after the BOINC restart).

Conan
ID: 906 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 907 - Posted: 16 Nov 2016, 21:12:06 UTC - in response to Message 906.  

My two 16t work units are using just a single core each.
I did tell BOINC that I had 16 cores but in a cc_config.xml file but this made no difference.
I have just added the app_config.xml file posted above.

However I am unable to restart BOINC Client at this stage to make it read the file due to me running a QMC work unit. Despite it having checkpointing, this appears to not be working as it will start from 0.00 if I stop BOINC for any reason. It is currently at 33 hours with around 50 still to go so I will have to wait.

The yafu work units also went back to 0.00 along with the QMC WU when my PSU gave a loud POP and started issuing smoke 2 days ago.
They are also at 33 hours and about a quarter done.

Conan


Well that QMC job was telling fibs, it said it was at 33% but it was not, when it passed 34 hours run time it moved to 1% completed.
With that first checkpoint I have been able to restart BOINC Client and it has read the app_config.xml from firstomega and is now running multiple cores as it should of been doing in the first place.
After 21 min 11 sec it has moved to 0.312% completed, so we will see how it goes (it restarted again from 0.00 after the BOINC restart).

Conan


After almost 20.5 hours the WU is now at a bit over 16.5%. So progressing along but it is going to take at least 100 hours to finish this, they are long work units.
What is the normal run time for these 16t's?

Conan
ID: 907 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 908 - Posted: 17 Nov 2016, 10:51:27 UTC - in response to Message 907.  



Well that QMC job was telling fibs, it said it was at 33% but it was not, when it passed 34 hours run time it moved to 1% completed.
With that first checkpoint I have been able to restart BOINC Client and it has read the app_config.xml from firstomega and is now running multiple cores as it should of been doing in the first place.
After 21 min 11 sec it has moved to 0.312% completed, so we will see how it goes (it restarted again from 0.00 after the BOINC restart).

Conan


After almost 20.5 hours the WU is now at a bit over 16.5%. So progressing along but it is going to take at least 100 hours to finish this, they are long work units.
What is the normal run time for these 16t's?

Conan


Well the work unit finished after a run time of 335205 seconds and a cpu time of 874320.70 seconds.
This says it ran for 93 hours and received 2096 credits.
As it did not run this long when I finally got all the cores working on the problem it must of been adding up all the time it ran when using only a single core, which was about 30 hours then restart, 30 hours then restart and finally another 30 hours with all cores.

As such the credit turned out to be miserable at just 2 cr/h counting the CPU time and 22 cr/h counting the RUN time.

I will see how the second work unit runs using all cores from the start, hopefully a bit beter run time and therefore credit.

Conan
ID: 908 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile yoyo_rkn
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 22 Aug 11
Posts: 723
Credit: 16,445,605
RAC: 86
Germany
Message 909 - Posted: 17 Nov 2016, 20:52:35 UTC - in response to Message 908.  

Many of the 16t workunits are running short. But there are some which needs to run over the full time. I would assume that they run roughly 25h on 16 cores.

yoyo
ID: 909 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marmot

Send message
Joined: 5 Nov 15
Posts: 33
Credit: 53,531,496
RAC: 0
United States
Message 912 - Posted: 10 Dec 2016, 9:32:21 UTC - in response to Message 908.  
Last modified: 10 Dec 2016, 9:35:29 UTC



Well the work unit finished after a run time of 335205 seconds and a cpu time of 874320.70 seconds.
This says it ran for 93 hours and received 2096 credits.

As such the credit turned out to be miserable at just 2 cr/h counting the CPU time and 22 cr/h counting the RUN time


Are they all going to be that low?

Maybe I should terminate these 2 16t's and go back to 8t?
ID: 912 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 935 - Posted: 21 Feb 2017, 3:00:42 UTC

Just finished this 16t work unit after 14 days WU 715200
It ran the whole time in single CPU mode and would not switch to to use 16 cores, which is why it took so long.

Conan
ID: 935 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile yoyo_rkn
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist

Send message
Joined: 22 Aug 11
Posts: 723
Credit: 16,445,605
RAC: 86
Germany
Message 936 - Posted: 23 Feb 2017, 19:39:38 UTC - in response to Message 935.  

Thanks for finishing a 16t task. Those are realy needed and not many user are running them.

It's curious that this workunit runs only on a single core the whole time. I agree, there are phases where it runs only on a single core, especially at the end. But his shouldn't happen the whole time if you don't play arround with boinc settings and app_config.

yoyo
ID: 936 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 962 - Posted: 23 Mar 2017, 10:51:47 UTC

I have another 16t work unit and it also is running on just the single core (over 3 days so far).
I run Amicable Numbers and it runs on the number of cores set for it (was 16 but have reduced to 8). When running Milkyway it also uses the full 16 cores.

So I don't know why YAFU wont use the cores I have, nothing is at high priority which usually will stop a "mt" WU from running.

It is only the 16t wu's as the 8t and 4t work units on this host run the required number of cores.

Conan
ID: 962 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 966 - Posted: 2 Apr 2017, 22:26:55 UTC - in response to Message 962.  

I have another 16t work unit and it also is running on just the single core (over 3 days so far).
I run Amicable Numbers and it runs on the number of cores set for it (was 16 but have reduced to 8). When running Milkyway it also uses the full 16 cores.

So I don't know why YAFU wont use the cores I have, nothing is at high priority which usually will stop a "mt" WU from running.

It is only the 16t wu's as the 8t and 4t work units on this host run the required number of cores.

Conan


This one finally finished after about 13 days WU 728864.
Again it ran just in single mode and would not use all the available cores.

Conan
ID: 966 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marmot

Send message
Joined: 5 Nov 15
Posts: 33
Credit: 53,531,496
RAC: 0
United States
Message 967 - Posted: 6 Apr 2017, 14:15:40 UTC - in response to Message 966.  
Last modified: 6 Apr 2017, 14:17:16 UTC

I have another 16t work unit and it also is running on just the single core (over 3 days so far).
I run Amicable Numbers and it runs on the number of cores set for it (was 16 but have reduced to 8). When running Milkyway it also uses the full 16 cores.

So I don't know why YAFU wont use the cores I have, nothing is at high priority which usually will stop a "mt" WU from running.

It is only the 16t wu's as the 8t and 4t work units on this host run the required number of cores.

Conan


This one finally finished after about 13 days WU 728864.
Again it ran just in single mode and would not use all the available cores.

Conan




All the WU types (MT, 4T, etc) have a consolidation period in between ECM and GNFS sections where YAFU runs as a solo process with 1 to 16 cores.
At the very end, YAFU.exe runs in single thread, NCI mode with high disk usage as it compiles the data into it's final result.

Maybe it's possible that every time you were viewing the WU that it was in consolidation mode?
The consolidation can take 15 minutes to an hour on the 16T and the final database collection can take some hours also.

If that's not what happened, check your app_config.xml for typos.
It's always a typo that gets me so I switched to Notepad++ and it color codes the tags and turns them red when the tags don't match up.

(BTW, the credit you received for that WU was horrible!)
ID: 967 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 968 - Posted: 7 Apr 2017, 12:22:36 UTC

G'Day marmot,
The work unit only ever ran on one cpu. This I know as the other 15 cpu's were all running other projects and did so for the nearly 2 weeks that the work unit ran.

I don't have an "app_config.xml" file, don't recall ever having one or ever creating one, for any project (also not too sure what to put in one either, even using the wiki as a guide).

The 16t work units have run OK on this computer before but the last 2 that have run have both only used a single core.

Originally only 1 cpu core was used till I changed "cc_config.xml" to use all 16 then things ran OK for awhile.

4t and 8t work units run without issue and use the required number of cores (can't recall if normal YAFU uses all 16 cores or not, as it has been awhile since I have had one).

Conan
ID: 968 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 969 - Posted: 7 Apr 2017, 22:37:49 UTC - in response to Message 968.  
Last modified: 7 Apr 2017, 22:38:41 UTC

G'Day marmot,
The work unit only ever ran on one cpu. This I know as the other 15 cpu's were all running other projects and did so for the nearly 2 weeks that the work unit ran.

I don't have an "app_config.xml" file, don't recall ever having one or ever creating one, for any project (also not too sure what to put in one either, even using the wiki as a guide).

The 16t work units have run OK on this computer before but the last 2 that have run have both only used a single core.

Originally only 1 cpu core was used till I changed "cc_config.xml" to use all 16 then things ran OK for awhile.

4t and 8t work units run without issue and use the required number of cores (can't recall if normal YAFU uses all 16 cores or not, as it has been awhile since I have had one).

Conan

Have to take back the bit about not ever having an app_config.xml file as I copied one earlier in this thread, but it seems to have not worked and I no longer have it.
Other projects don't need one so why here?

I have another 16t download, again only using a single core.

Conan
ID: 969 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 5 Sep 11
Posts: 46
Credit: 6,804,219
RAC: 3,442
Australia
Message 970 - Posted: 8 Apr 2017, 8:41:39 UTC - in response to Message 969.  

G'Day marmot,
The work unit only ever ran on one cpu. This I know as the other 15 cpu's were all running other projects and did so for the nearly 2 weeks that the work unit ran.

I don't have an "app_config.xml" file, don't recall ever having one or ever creating one, for any project (also not too sure what to put in one either, even using the wiki as a guide).

The 16t work units have run OK on this computer before but the last 2 that have run have both only used a single core.

Originally only 1 cpu core was used till I changed "cc_config.xml" to use all 16 then things ran OK for awhile.

4t and 8t work units run without issue and use the required number of cores (can't recall if normal YAFU uses all 16 cores or not, as it has been awhile since I have had one).

Conan

Have to take back the bit about not ever having an app_config.xml file as I copied one earlier in this thread, but it seems to have not worked and I no longer have it.
Other projects don't need one so why here?

I have another 16t download, again only using a single core.

Conan

Anyone know how to get these things to use more than 1 core?

4t and 8t work fine but 16t does not.

Conan
ID: 970 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PAK-FA

Send message
Joined: 19 Oct 15
Posts: 4
Credit: 10,875,085
RAC: 0
Russia
Message 975 - Posted: 22 Apr 2017, 3:59:10 UTC

I can confirm that I'm also receiving 16t tasks that running only on 1 thread, may be all 16t tasks have this issue? may be some program fix needed?
ID: 975 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Yafu 16t




Datenschutz / Privacy Copyright © 2011-2024 Rechenkraft.net e.V. & yoyo