Advanced search

Message boards : News : CPU jobs on Linux

Author Message
Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48820 - Posted: 5 Feb 2018 | 19:30:28 UTC

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48821 - Posted: 5 Feb 2018 | 20:05:56 UTC

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48823 - Posted: 5 Feb 2018 | 20:47:06 UTC

Sure, I can help.

Matt Kowal
Avatar
Send message
Joined: 27 May 14
Posts: 9
Credit: 92,568,568
RAC: 0
Level
Thr
Scientific publications
watwat
Message 48824 - Posted: 5 Feb 2018 | 21:18:15 UTC
Last modified: 5 Feb 2018 | 21:23:18 UTC

This forum news post was syndicated to your Twitter account, however, the link is broken.

Relevant post: https://twitter.com/gpugrid/status/960604705171808256

The link resolves to https://www.gpugrid.net/extra_arg_utm_source.html

I have reposted your call to the BOINC subreddit

klepel
Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,196,461,293
RAC: 1,617,116
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48825 - Posted: 5 Feb 2018 | 21:45:30 UTC - in response to Message 48821.
Last modified: 5 Feb 2018 | 21:47:43 UTC

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.

+1

PS Unfortunatelly, they crash my computer with my strongest GPU frequently, so I will not run them on this computer.

John C MacAlister
Send message
Joined: 17 Feb 13
Posts: 181
Credit: 144,871,276
RAC: 0
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 48826 - Posted: 5 Feb 2018 | 22:51:50 UTC - in response to Message 48820.

Unfortunately, I gave up on Linux and run Win 10.


Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?


____________
John

Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48827 - Posted: 5 Feb 2018 | 23:23:41 UTC - in response to Message 48821.

Do you want to make them more appealing to crunch?? Take the QMML tasks OFF the Boinc CreditNew credit award mechanism and assign them fixed values like you do for the gpu tasks.



We are testing this.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48828 - Posted: 6 Feb 2018 | 0:22:33 UTC - in response to Message 48826.

I've had good luck with the Linux apps up until the recent gpu application errors that started this month. The cpu tasks ran fine.

I and others have voiced our displeasure with the credit awarded for the flops used for the QM tasks in this thread.
New Student and QMML Project

Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 48833 - Posted: 6 Feb 2018 | 9:02:58 UTC - in response to Message 48828.

we are testing different credit systems now.

Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 48834 - Posted: 6 Feb 2018 | 10:45:39 UTC - in response to Message 48833.
Last modified: 6 Feb 2018 | 10:46:23 UTC

We don't use CreditNew but the previous credit system. In any case, two changes were made yesterday:

* CPU threads are limited to 4 (you should still be able to crunch multiple WUs at once, please check)
* Credits should be in line with other projects'

Let us know.

Profile Bikermatt
Send message
Joined: 8 Apr 10
Posts: 37
Credit: 3,839,902,185
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48836 - Posted: 6 Feb 2018 | 12:54:52 UTC - in response to Message 48834.


* CPU threads are limited to 4 (you should still be able to crunch multiple WUs at once, please check)

Let us know.


Boinc is still assigning all of my 32 threads to one task even though it is only using 4.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48837 - Posted: 6 Feb 2018 | 13:29:06 UTC - in response to Message 48820.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

I have three machines on it, but I can run only one work unit at a time on average. That is because when any more start up at once, they error out, as has been discussed before. And I run two cores per work unit for efficiency. But if you could solve the start-up problem, I could run more.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48838 - Posted: 6 Feb 2018 | 13:55:26 UTC

I don't see that you have made an announcement on the BOINC forum yet. The Projects section would probably be best.
http://boinc.berkeley.edu/dev/forum_forum.php?id=11

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48839 - Posted: 6 Feb 2018 | 14:24:00 UTC

I have an Intel 2600K with 8 logical cores. I wanted to reserved 2 cores for feeding 2 GPUs that are running Folding@home. I set the computing preference in boinc to use, at most, 80% of processors (6 cores).

Data on 19 WUs before GPUGrid changes (processor usage varied but 5-6 cores on average I think)

Average run time (sec): 3,129.23
Average CPU time (sec): 16,122.19
Average credit per WU: 228.7
Average WU per day: 27.6
PPD: 6314.8

Data on 15 WUs after GPUGrid changes. Processor usage was 4 cores even though set at 6)

Average run time (sec): 3,566.32
Average CPU time (sec): 14,114.28
Average credit per WU: 819.284
Average WU per day: 24.2
PPD: 19848.5

Summary: Processor usage seems to be maxed out at 4. Run time has increased, CPU time has decreased, WU completed per day has decreased and PPD has increased significantly.

Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 48840 - Posted: 6 Feb 2018 | 14:57:09 UTC - in response to Message 48836.
Last modified: 6 Feb 2018 | 15:09:56 UTC



Boinc is still assigning all of my 32 threads to one task even though it is only using 4.


Ouch. This should not happen. May be fixed now.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 48842 - Posted: 6 Feb 2018 | 15:50:39 UTC - in response to Message 48837.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

I have three machines on it, but I can run only one work unit at a time on average. That is because when any more start up at once, they error out, as has been discussed before. And I run two cores per work unit for efficiency. But if you could solve the start-up problem, I could run more.


I agree. There were too many issues that had not been resolved. On top of that the credit much worse than even CreditNew. I see the credit has been changed just saying there are reasons for the lack of CPU time.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48845 - Posted: 6 Feb 2018 | 17:48:28 UTC - in response to Message 48834.

Are you sure that you are using an "older" credit mechanism? From the response in the "New Student and QMML" thread from Richard Haselgrove who corrected me in my assumption you might be using an "older" mechanism.

Be careful of your terms. 'CreditNew' has been the default BOINC mechanism since 2010. I suspect this is what GPUGrid is using for these tasks: the support mechanisms for 'even older credit' have been removed from the codebase.

I wonder where you found the older codebase that has been removed that contained the "older" credit award algorithm. If you do in fact have such, I would like access to it. Or have it reinstituted into the BOINC Github codebase.

It would be helpful in persuading the BOINC maintainers that there is in fact a way to return to the older credit algorithm. One of their stated reasons why they said they would not change from CreditNew is that they said they no longer have the original code and can't replicate it.

That said, it looks like the award for QC cpu tasks is much more appealing now.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48847 - Posted: 6 Feb 2018 | 19:21:26 UTC - in response to Message 48839.

Hmmm ... I just ran a new QC task with the supposed new credit. Not seeing any difference.

Run time 3,292.22
CPU time 12,925.47
Validate state Valid
Credit 110.63

I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.

STARBASEn
Avatar
Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 48850 - Posted: 6 Feb 2018 | 23:50:37 UTC

Since just after mid day yesterday (UTC) I have noticed an increase in credit awarded for the QC WU's. Doing some quick calcs, it appears the increase is about 4.5x of what we were getting. It also appears they are more fixed in value proportional to the size of the WU. My faster machines are getting over 500 credits/hr (4 cores) compute time whereas the slower machines are getting proportionately less/hr and still getting equivalent credit but over a longer period of time than the faster ones.

Well, at least my avg credit per day will not be taking as much of a hit per day as it has been without Linux GPU WU's :).

So far, I have 5 machines with 4 cores each running the QC project and will add one more when I install the memory upgrade on one of the headless systems.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48851 - Posted: 7 Feb 2018 | 0:28:50 UTC - in response to Message 48850.

I'm not sure the higher credit is not due to the larger molecule size in the latest tasks that Dominik explained to me here.

Trotador
Send message
Joined: 25 Mar 12
Posts: 103
Credit: 9,769,314,893
RAC: 39,662
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 48857 - Posted: 7 Feb 2018 | 6:26:25 UTC

No higher credits for the tasks I've crunched yesterday and today.

I stop and will try to understand what is happening.

NUCCpod_NAPTIMELABS_01
Send message
Joined: 18 Aug 17
Posts: 6
Credit: 174,440,173
RAC: 0
Level
Ile
Scientific publications
watwat
Message 48858 - Posted: 7 Feb 2018 | 6:33:41 UTC - in response to Message 48837.

I've also been having trouble with work units erroring out in this way. I have over 150 cpu cores spread out across a variety of machines, all under linux. Just a few moments ago I attempted to attach to GPUGRID only to have computational error after computational error. I hope this is fixed shortly as I would love to have GPUGRID as one of my default projects.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48859 - Posted: 7 Feb 2018 | 7:46:25 UTC

Yes, credit is doing something very strange. I got 111 credits for 3292 seconds of cpu time.

klepel got 1362 credits for the same time.

Run time 3,262.28
CPU time 12,834.34
Validate state Valid
Credit 1,361.79

Task 13118994

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 48862 - Posted: 7 Feb 2018 | 12:23:54 UTC - in response to Message 48847.


I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.


Are you seriously comparing SETI to GPUGRID?!

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 48863 - Posted: 7 Feb 2018 | 12:53:02 UTC - in response to Message 48862.


I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.


Are you seriously comparing SETI to GPUGRID?!


CreditNew is CreditNew.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 48864 - Posted: 7 Feb 2018 | 13:33:40 UTC - in response to Message 48863.


I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.


Are you seriously comparing SETI to GPUGRID?!


CreditNew is CreditNew.

You cannot compare one project's credit to another.

computezrmle
Send message
Joined: 10 Jun 13
Posts: 9
Credit: 295,692,471
RAC: 0
Level
Asn
Scientific publications
watwatwatwatwat
Message 48866 - Posted: 7 Feb 2018 | 16:54:10 UTC - in response to Message 48864.

You cannot compare one project's credit to another.

At least it should be comparable as described in the BOINC documentation.
See: http://boinc.berkeley.edu/trac/wiki/CreditNew#Cross-projectversionnormalization

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48867 - Posted: 7 Feb 2018 | 17:01:28 UTC - in response to Message 48864.


I used 4 cores to generate 110 credits for 54 minutes of compute time.

I can use one core to generate 108 credits for 60 minutes of compute time for SETI CPU tasks.

No reason to run these tasks still for me.


Are you seriously comparing SETI to GPUGRID?!


CreditNew is CreditNew.

You cannot compare one project's credit to another.

One of the stated objectives of CreditNew it to make credit the same across all projects for the same amount of cobblestones used to compute.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 48872 - Posted: 7 Feb 2018 | 18:35:25 UTC

Thus my comment about CreditNew. CPU projects that have higher or lower then typical RAC are most likely using something else besides CreditNew like a fixed credit or another algorithm.

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48873 - Posted: 7 Feb 2018 | 18:46:31 UTC - in response to Message 48872.

Yes I understood your post and sentiment. My post was directed at the other poster's incredulous comment.

This project itself utilize both mechanisms. CreditNew for cpu tasks and fixed credit awards for gpu tasks.

As far as I have been able to find, that is unique among projects. Usually it is either/or not both.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 48876 - Posted: 7 Feb 2018 | 22:11:38 UTC - in response to Message 48873.

Yes I understood your post and sentiment. My post was directed at the other poster's incredulous comment.

This project itself utilize both mechanisms. CreditNew for cpu tasks and fixed credit awards for gpu tasks.

As far as I have been able to find, that is unique among projects. Usually it is either/or not both.


I wasn't referencing you as I didn't quote you. ;)

I agree.

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 48893 - Posted: 10 Feb 2018 | 15:13:42 UTC
Last modified: 10 Feb 2018 | 15:18:45 UTC

Would you please list the QC project progress on the server status page as well:

http://www.gpugrid.net/server_status.php

Thanks.

Another issue is that your app does not dynamically allocate CPU cores according to the BOINC settings. Instead it claims all physically present cores. That is a major problem when trying to run computations on the GPU as well because to do so, the GPU project automatically (or I manually) reserve(s) one CPU core per GPU task.
Example: When the BOINC manager is set to use 7 of the 8 cores to do CPU computations, your CPU client grabs all 8 cores (or since recently 2x 4 cores).
That is not acceptable.
Please fix this to attract more people to donate CPU cycles to your project.

Michael.
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

Profile SMTB1963
Avatar
Send message
Joined: 27 Jun 10
Posts: 38
Credit: 524,420,921
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 48894 - Posted: 10 Feb 2018 | 17:48:45 UTC - in response to Message 48893.

Another issue is that your app does not dynamically allocate CPU cores according to the BOINC settings. Instead it claims all physically present cores.


I'm seeing this behavior as well. On my Ryzen 1700X system with 2 GPUs, these WUs basically take over all CPUs and throw the GPUs into "Waiting to run".

I suppose one could set max_concurrent in an app_config.xml to fix this...what would be the proper app name to use?

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 48895 - Posted: 10 Feb 2018 | 17:54:26 UTC - in response to Message 48894.

QC is the proper app name. This is how I limit QC to 2 threads per task.

<app>
<name>QC</name>
<max_concurrent>1</max_concurrent>
</app>
<app_version>
<app_name>QC</app_name>
<plan_class>mt</plan_class>
<avg_ncpus>2.000000</avg_ncpus>
<cmdline>--nthreads 2</cmdline>


I also just run 1 task at a time to avoid the starting two tasks at the same time flaw in the application.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 48988 - Posted: 19 Feb 2018 | 8:24:05 UTC

An error on a wu (task 17040682):

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
An HTTP error occurred when trying to retrieve this URL.
HTTP errors are often intermittent, and a simple retry will get you on your way.
ConnectionError(MaxRetryError("HTTPSConnectionPool(host='repo.continuum.io', port=443): Max retries exceeded with url: /pkgs/main/linux-64/repodata.json.bz2 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fc2a3f56860>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))",),)


Traceback (most recent call last):
File "pre_script.py", line 13, in <module>
raise Exception("Error installing h5py")
Exception: Error installing h5py
08:49:09 (1252): $PROJECT_DIR/miniconda/bin/python exited; CPU time 0.469942
08:49:09 (1252): app exit status: 0x1
08:49:09 (1252): called boinc_finish(195)

Profile Logan Carr
Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49092 - Posted: 24 Feb 2018 | 0:21:06 UTC - in response to Message 48820.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?


okay, I'm going to install Linux right now on my computer and it should be ready tonight or early tomorrow.
____________
Cruncher/Learner in progress.

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49094 - Posted: 24 Feb 2018 | 12:04:32 UTC - in response to Message 48988.


Traceback (most recent call last):
File "pre_script.py", line 13, in <module>
raise Exception("Error installing h5py")
Exception: Error installing h5py
08:49:09 (1252): $PROJECT_DIR/miniconda/bin/python exited; CPU time 0.469942
08:49:09 (1252): app exit status: 0x1
08:49:09 (1252): called boinc_finish(195)


If you are running the latest distros from Ubuntu or Mint you may need to install the python-support package.

wget http://launchpadlibrarian.net/109052632/python-support_1.0.15_all.deb

sudo dpkg -i python-support_1.0.15_all.deb

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49096 - Posted: 24 Feb 2018 | 15:57:29 UTC

One of my CPUs is crunching linux jobs, I will add two more next week.

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49164 - Posted: 16 Mar 2018 | 11:53:15 UTC

I have added three. Athlon 5350, I3 3240, I3 6100. Not the best ones but doing their job. I can add more but I would like to know how many WUs can we expect for the Linux QM app?

BTW ATM just 92 users are crunching QM, that's sad :(

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49165 - Posted: 16 Mar 2018 | 13:05:14 UTC - in response to Message 49164.
Last modified: 16 Mar 2018 | 13:09:04 UTC

I have added another machine, and now have four on it (2 i7-3770, 1 i7-4790 and 1 Ryzen 1700), with two to four cores per machine allocated via the resource share. The main problem in running them is that when two or more start up at the same time, they error out. That happens mainly during reboots, but otherwise they never start up at the same time. I leave my machines running 24/7, so I don't reboot very often.

And to minimize the problem, you can run with the default 4 cores per work unit and only 4 cores (or less) per machine on average, so that they usually don't start more than one work unit at a time anyway. In that way, it is a manageable problem for me, though it would be best if they fix it. I am sure more people would then be willing to run it.

Also a Windows version would help of course, and for that they had better be seriously thinking about VirtualBox.

captainjack
Send message
Joined: 9 May 13
Posts: 171
Credit: 2,322,454,288
RAC: 2,372,707
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49167 - Posted: 16 Mar 2018 | 19:28:12 UTC

Jim 1348 said:

Also a Windows version would help of course, and for that they had better be seriously thinking about VirtualBox.


If you want to go the virtualbox route, you can create your own virtualbox instance, install your favorite flavor of Linux (I chose Ubuntu), make sure that gcc is installed, install BOINC and start running the Linux version of the Quantum Chemistry tasks.

It took me a few tries to figure out that gcc needed to be installed, but now they seem to be running fine.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 49168 - Posted: 17 Mar 2018 | 15:09:22 UTC - in response to Message 49164.

I have added three. Athlon 5350, I3 3240, I3 6100. Not the best ones but doing their job. I can add more but I would like to know how many WUs can we expect for the Linux QM app?

BTW ATM just 92 users are crunching QM, that's sad :(


People aren't running it since it has so many issues that haven't been addressed.

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49169 - Posted: 17 Mar 2018 | 16:42:59 UTC

Lucky me (not even a single problem on my end)

flashawk
Send message
Joined: 18 Jun 12
Posts: 297
Credit: 3,572,627,986
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49171 - Posted: 18 Mar 2018 | 4:07:07 UTC

The main reason why I came here was to put my GPU's to work, my CPU cores are all very busy with CPDN.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 49172 - Posted: 18 Mar 2018 | 12:35:01 UTC - in response to Message 49169.

Lucky me (not even a single problem on my end)


Start two at once..

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49173 - Posted: 18 Mar 2018 | 12:39:17 UTC - in response to Message 49172.

I understand that. I'm using only 4C or 2c/4t CPUs so I can't start two at once. Probably that's why i don't have any issues :)

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49174 - Posted: 18 Mar 2018 | 13:37:13 UTC - in response to Message 49167.

Jim 1348 said:
Also a Windows version would help of course, and for that they had better be seriously thinking about VirtualBox.


If you want to go the virtualbox route, you can create your own virtualbox instance, install your favorite flavor of Linux (I chose Ubuntu), make sure that gcc is installed, install BOINC and start running the Linux version of the Quantum Chemistry tasks.

Thanks, but I have five Ubuntu machines. I was offering that only as advice if they want to increase their processing power. They need to enlist the Windows users.

Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 49179 - Posted: 20 Mar 2018 | 21:53:21 UTC - in response to Message 49174.

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49180 - Posted: 20 Mar 2018 | 22:03:00 UTC - in response to Message 49179.

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.



Wow, wow, wow! :D
I will add some more CPUs.

When can we expect some info about scientific results created with this app?

Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 49193 - Posted: 22 Mar 2018 | 10:59:44 UTC - in response to Message 49180.


When can we expect some info about scientific results created with this app?


Months away, we have just started.

_Ryle_
Send message
Joined: 7 Jun 09
Posts: 24
Credit: 1,138,093,416
RAC: 125,082
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49197 - Posted: 22 Mar 2018 | 13:16:35 UTC

Could someone who knows how, make a description of exactly which dependencies are needed to make the QC app run flawlessly, in the FAQ section? I think it is a good place for it to be described.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49204 - Posted: 24 Mar 2018 | 9:23:17 UTC - in response to Message 49173.
Last modified: 24 Mar 2018 | 9:31:11 UTC

I understand that. I'm using only 4C or 2c/4t CPUs so I can't start two at once. Probably that's why i don't have any issues :)


Once those issues have been solved I will gladly set a 16/32t Threadripper on the QC tasks to shovel them away ;)
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49205 - Posted: 25 Mar 2018 | 8:57:18 UTC
Last modified: 25 Mar 2018 | 9:04:26 UTC

And to minimize the problem, you can run with the default 4 cores per work unit and only 4 cores (or less) per machine on average, so that they usually don't start more than one work unit at a time anyway. In that way, it is a manageable problem for me, though it would be best if they fix it. I am sure more people would then be willing to run it.


I have set up a i3 Sandy Bridge machine (2c/4t) on Ubuntu and use the default config as suggested above, but all tasks report a calculation error after just 1-3 minutes. Any idea what goes wrong here?

http://www.gpugrid.net/result.php?resultid=17336453
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

captainjack
Send message
Joined: 9 May 13
Posts: 171
Credit: 2,322,454,288
RAC: 2,372,707
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49206 - Posted: 25 Mar 2018 | 12:18:12 UTC

JoergF

Try installing gcc and see if that helps.

In a terminal session

sudo apt-get install gcc

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49207 - Posted: 25 Mar 2018 | 18:36:21 UTC - in response to Message 49206.

JoergF

Try installing gcc and see if that helps.

In a terminal session
sudo apt-get install gcc


Thank you... I have installed it. However I am not able to test it as there seems to be a daily quota of 2 tasks per computer and I have to wait for the next day. Really, in view of of >10.000 unsent QC tasks, that limitation is somewhat surprising.
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

captainjack
Send message
Joined: 9 May 13
Posts: 171
Credit: 2,322,454,288
RAC: 2,372,707
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49208 - Posted: 25 Mar 2018 | 20:34:23 UTC

JoergF said:

However I am not able to test it as there seems to be a daily quota of 2 tasks per computer and I have to wait for the next day


There is a daily limit if a cruncher starts turning more than the usual number of errors. Once you start turning in valid tasks, the daily limit will go back up. I have been caught in it a few times when running test tasks.

Hopefully you will get better results tomorrow.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49209 - Posted: 26 Mar 2018 | 6:53:19 UTC - in response to Message 49208.

Thank you.. seems to work now :)
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49211 - Posted: 26 Mar 2018 | 19:13:52 UTC - in response to Message 49179.

People should expect infinite number of workunits...
We will run this for ever.


Oh, well.
So we dream for a opencl client (or an sse/avx cpu optimization)

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49212 - Posted: 26 Mar 2018 | 20:07:51 UTC - in response to Message 49211.

Oh, well.
So we dream for a opencl client (or an sse/avx cpu optimization)

As you probably know, the FMA version of TN-Grid is faster than the AVX version. At least that was my result comparing a Ryzen 1700 (FMA) to an i7-4770 (AVX), both on Ubuntu.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49213 - Posted: 27 Mar 2018 | 8:20:51 UTC - in response to Message 49212.

As you probably know, the FMA version of TN-Grid is faster than the AVX version. At least that was my result comparing a Ryzen 1700 (FMA) to an i7-4770 (AVX), both on Ubuntu.


I know.
And, i forgot, a Windows app!!! :-)

klepel
Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,196,461,293
RAC: 1,617,116
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49215 - Posted: 27 Mar 2018 | 17:58:25 UTC - in response to Message 49179.

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.

I still think, the main obstacle to gain a wider LINUX contributor base is to solve the start-up error when two WUs start at the same time. In my view, this hinders the implementation of the app on newer computers with more than 4 threads/cores, as the other available computer threads/cores are not loaded by other BOINC projects.

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49216 - Posted: 27 Mar 2018 | 18:36:09 UTC - in response to Message 49215.

The linux QM app runs fine but it requires some packages to be installed. People should expect infinite number of workunits...

We will run this for ever.

I still think, the main obstacle to gain a wider LINUX contributor base is to solve the start-up error when two WUs start at the same time. In my view, this hinders the implementation of the app on newer computers with more than 4 threads/cores, as the other available computer threads/cores are not loaded by other BOINC projects.


True. I'm using only 2c/4t and 4c CPUs because of that. Ryzen 8c/16t is crunching WCG.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49217 - Posted: 27 Mar 2018 | 21:02:46 UTC
Last modified: 27 Mar 2018 | 21:45:43 UTC

You can sort of learn to live with its idiosyncrasies after a while. They are more an annoyance at first. But I wonder if a non multi-core version would fix the start-up problems? It would be worth looking into.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49270 - Posted: 15 Apr 2018 | 9:16:06 UTC
Last modified: 15 Apr 2018 | 9:19:17 UTC

May I touch upon this matter again after 2,5-3 weeks... at the risk of being a pain in the neck... is there any progress regarding concurrent QC tasks? I would really like to use a 8-16 core CPU (instead of my i3) and run several jobs at the same time. Hope that the admins can take some time to follow up, in view of the many jobs we still have to crunch.

Thanks.
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

Profile Logan Carr
Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49298 - Posted: 17 Apr 2018 | 14:10:21 UTC - in response to Message 48820.

Hey,

What are the recommended PC specs you recommend for these Linux job units? (minimal CPU and ram?) Thanks
____________
Cruncher/Learner in progress.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49305 - Posted: 17 Apr 2018 | 21:41:46 UTC - in response to Message 49298.

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49308 - Posted: 18 Apr 2018 | 8:26:36 UTC - in response to Message 49298.

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49309 - Posted: 18 Apr 2018 | 11:11:00 UTC - in response to Message 49308.

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.

Just to confirm, that's 1GB per work unit?

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49310 - Posted: 18 Apr 2018 | 11:18:15 UTC - in response to Message 49305.
Last modified: 18 Apr 2018 | 11:20:10 UTC

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.


pardon me for jumping in, does that mean it is possible now to run several QC tasks at the same time? For example, 4 Jobs on the Ryzen 1700?
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49311 - Posted: 18 Apr 2018 | 11:32:10 UTC - in response to Message 49310.
Last modified: 18 Apr 2018 | 11:33:45 UTC

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts. I am investigating possible workarounds but no timeline yet, sorry. Requirements are in some other thread; they are rather mild (only thing you need to have the gcc package installed).

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 49312 - Posted: 18 Apr 2018 | 11:44:27 UTC - in response to Message 49310.

I have five QC running at the moment on two machines, and they are taking from 230 MB to 260 MB. I would plan on at least 300 MB to be safe.


pardon me for jumping in, does that mean it is possible now to run several QC tasks at the same time? For example, 4 Jobs on the Ryzen 1700?


Best to just run 1 per computer via app_config or you'll eventually get two starting at once. They'll crash at once, and end up in this loop.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49313 - Posted: 18 Apr 2018 | 13:46:14 UTC - in response to Message 49309.

I now have one running at 1016 MB for a few minutes, but now down to 932 MB. It looks like the upper limit is a bit elastic.

Just to confirm, that's 1GB per work unit?

Yes, but now I see 1466 MB for a single work unit, the most I have seen.

Note however that I use an app_config to limit them to only one CPU core per work unit, but I do not limit the number of work units that can run at a time. It would undoubtedly be more efficient use of memory to allow the default value of four cores to run on a single work unit. It probably would not use much more memory than a single core, but what the maximum is I don't really know. I have 32 GB, so I have never really paid much attention to it. I use BOINCTasks to measure the memory use by the way.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49314 - Posted: 18 Apr 2018 | 16:00:00 UTC - in response to Message 49311.

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts.


Okay, thank you :)
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

Profile Logan Carr
Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49316 - Posted: 18 Apr 2018 | 21:12:02 UTC - in response to Message 49311.
Last modified: 18 Apr 2018 | 21:13:14 UTC

Requirements are in some other thread; they are rather mild (only thing you need to have the gcc package installed).


I have looked around and cannot find any requirements for this specific project. The only CPU requirements I see are here
http://www.gpugrid.net/join.php

But that looks like general use to me.

I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.
____________
Cruncher/Learner in progress.

NUCCpod_NAPTIMELABS_01
Send message
Joined: 18 Aug 17
Posts: 6
Credit: 174,440,173
RAC: 0
Level
Ile
Scientific publications
watwat
Message 49317 - Posted: 18 Apr 2018 | 22:26:57 UTC - in response to Message 49316.


I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.


For questions like this, wuprop is a fantastic resource. Check the link and you can see things like time to complete for various CPUs and other requirements like memory. In this case looks like you may need 776.5 MB of RAM and an i3 should do just fine.

Profile Logan Carr
Send message
Joined: 12 Aug 15
Posts: 240
Credit: 64,069,811
RAC: 0
Level
Thr
Scientific publications
watwatwatwat
Message 49318 - Posted: 18 Apr 2018 | 23:13:18 UTC - in response to Message 49317.


I will make my question a little more simple... would a core i3 work fine with this project, and if so, would a gen 1 be fine, gen 2, or newer? My budget for another PC dedicated to cpu work is about 100 USD. I do not mind for a small desktop either without a big gpu slot. Thank you.


For questions like this, wuprop is a fantastic resource. Check the link and you can see things like time to complete for various CPUs and other requirements like memory. In this case looks like you may need 776.5 MB of RAM and an i3 should do just fine.



Thank you very much.
____________
Cruncher/Learner in progress.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49372 - Posted: 29 Apr 2018 | 8:43:29 UTC - in response to Message 49311.
Last modified: 29 Apr 2018 | 8:44:03 UTC

It is possible to run as many as you want concurrently. A bug unfortunately prevents simultaneous starts. I am investigating possible workarounds but no timeline yet, sorry.


One simple solution would be creating a TEMP file in the application directory. The first thing a job does is trying to create this file. In case the create command fails (because the file is already there or a multiple create/write conflict occurred) the job must back off for a while. If successful, this job is allowed to start and the others will try again in a couple of seconds. The now starting job shall delete the TEMP file in a timely manner, so that the others can also get started. So the TEMP file actually works like a (do-not-start) flag. You may also stop all tasks sometime and delete the TEMP at regular intervals, to make sure there is no failing or cancelled task leaving the file in place forever.

Frankly there are also other and more professional things like semaphores available in the OS, but the above is possibly the fastest solution.
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

3de64piB5uZAS6SUNt1GFDU9d...
Avatar
Send message
Joined: 20 Apr 15
Posts: 285
Credit: 1,102,216,607
RAC: 0
Level
Met
Scientific publications
watwatwatwatwatwat
Message 49373 - Posted: 29 Apr 2018 | 17:12:07 UTC
Last modified: 29 Apr 2018 | 17:13:52 UTC

...You may also stop all tasks


Edit: I mean to pause the tasks, not to cancel them of course. By the way, does the error show up also when multiple tasks are paused and then re-started/continued at the same time?
____________
I would love to see HCF1 protein folding and interaction simulations to help my little boy... someday.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49376 - Posted: 30 Apr 2018 | 12:28:51 UTC

I am having a lot of CPU Quantum Chemistry WUs error out as soon as they start on my Ubuntu machine. Some work but most error out. Is this inherent with the CPU app or is it my machine?

Below are the machine's tasks:
http://www.gpugrid.net/results.php?hostid=424454

ChristianVirtual
Send message
Joined: 16 Aug 14
Posts: 17
Credit: 378,346,925
RAC: 0
Level
Asp
Scientific publications
watwatwatwatwat
Message 49379 - Posted: 2 May 2018 | 12:08:20 UTC

Me too:

http://www.gpugrid.net/result.php?resultid=17510462

ChristianVirtual
Send message
Joined: 16 Aug 14
Posts: 17
Credit: 378,346,925
RAC: 0
Level
Asp
Scientific publications
watwatwatwatwat
Message 49380 - Posted: 2 May 2018 | 12:08:32 UTC
Last modified: 2 May 2018 | 12:08:58 UTC

(SORRY, double post)

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 7,520
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49384 - Posted: 2 May 2018 | 16:55:58 UTC - in response to Message 49376.
Last modified: 2 May 2018 | 16:57:03 UTC

I am having a lot of CPU Quantum Chemistry WUs error out as soon as they start on my Ubuntu machine. Some work but most error out. Is this inherent with the CPU app or is it my machine?
There's a bug in the app, which prevents more than 1 task starting simultaneously. When the task started successfully, you can start another task manually. Since there's no automated way for this, you should pause all but one task before you shut down your computer, then start them one by one. The other option is to limit the concurrently running QC apps to 1. Since this app uses only 4 threads (cores) you should utilize your other CPU cores with a different project.
To do this you should create / modify your app_config.xml file in the projects\www.gpugrid.net folder.

<app_config> <app> <name>QC</name> <max_concurrent>1</max_concurrent> </app> <app_version> <app_name>QC</app_name> <plan_class>mt</plan_class> <avg_ncpus>4</avg_ncpus> </app_version> </app_config>

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49405 - Posted: 7 May 2018 | 11:22:37 UTC

So I understand why I receive "error while computing" with almost 0 seconds of compute time (multiple WUs starting at once) but I don't understand the fairly high number of failed WUs with multiple thousand second or even over ten thousand second run times. Linked below are my error rates:

http://www.gpugrid.net/results.php?hostid=424454&offset=0&show_names=0&state=5&appid=

Does anyone think they can explain why the non WUs starting at once errors are occurring?

Richard Haselgrove
Send message
Joined: 11 Jul 09
Posts: 1576
Credit: 5,602,161,851
RAC: 8,766,393
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49406 - Posted: 7 May 2018 | 13:38:07 UTC - in response to Message 49405.

Did you stop the computer at any point, and let them all RE-start in unison - from whatever point they'd reached?

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49407 - Posted: 7 May 2018 | 14:04:06 UTC - in response to Message 49406.

Did you stop the computer at any point, and let them all RE-start in unison - from whatever point they'd reached?

From my knowledge, the computer only turned off once last week. It is on 24/7 otherwise. It looks like these errors are all over the place in terms of date.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49408 - Posted: 8 May 2018 | 11:00:59 UTC

We are losing CPU Volunteers, can anyone help?

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49409 - Posted: 8 May 2018 | 12:01:32 UTC - in response to Message 49408.

We are losing CPU Volunteers, can anyone help?



It's up to the scientists to sort. They will need a Windowa version to have any hope of getting a reasonable throughput.
____________
Radio Caroline, the world's most famous offshore pirate radio station.
Great music since April 1964. Support Radio Caroline Team -
Radio Caroline

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49414 - Posted: 8 May 2018 | 16:16:33 UTC - in response to Message 49409.

We are losing CPU Volunteers, can anyone help?



It's up to the scientists to sort. They will need a Windowa version to have any hope of getting a reasonable throughput.


Or just linux app without 'starting many at once' issue. I could add more than 100 cores but I cant because of that.

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49417 - Posted: 9 May 2018 | 9:49:02 UTC

We will talk this week with the devs of the QM CPU software to see how we can make a Windows build. Once we know the status and how much work it is we will update. But believe me we are extremely keen on a Windows version...

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49419 - Posted: 9 May 2018 | 11:19:36 UTC

Since you are using the wrapper from LHC@home why don't you use VirtualBox? This would eliminate the need for a Windows version. All Windows user of LHC@home can run LHC@home tasks, written in Scientific Linux, using Virtual Box.
Tullio

Failboat
Send message
Joined: 24 Apr 16
Posts: 2
Credit: 35,317,258
RAC: 0
Level
Val
Scientific publications
watwatwat
Message 49420 - Posted: 9 May 2018 | 23:15:38 UTC

changed my desktop settings to include cpu tasks again. (im in the pool so it wont show on my account). hope my contribution, small as it is, helps!

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49427 - Posted: 10 May 2018 | 7:24:21 UTC - in response to Message 49419.

Since you are using the wrapper from LHC@home why don't you use VirtualBox?


No, please.
Now i'm using a Linux vm with Virtual Box for this project and it's a nightmare.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49429 - Posted: 10 May 2018 | 10:42:27 UTC - in response to Message 49427.
Last modified: 10 May 2018 | 10:43:01 UTC

Since you are using the wrapper from LHC@home why don't you use VirtualBox?


No, please.
Now i'm using a Linux vm with Virtual Box for this project and it's a nightmare.

The LHC@home performance using Virtualbox vs direct from linux is a ridiculous loss in efficiency and performance, not to mention substantial ram usage. If we can avoid virtualbox outright I would consider that a win.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49430 - Posted: 10 May 2018 | 13:03:44 UTC - in response to Message 49429.

The LHC@home performance using Virtualbox vs direct from linux is a ridiculous loss in efficiency and performance, not to mention substantial ram usage. If we can avoid virtualbox outright I would consider that a win.

You keep saying that, which I think just shows that you have had problems with VirtualBox. Even if so, I don't know why that is a reason for GPUGrid not to use it. A lot of people can get it to work.

It is not a "ridiculous loss in efficiency", but about the same as using Windows on some projects optimized for Linux (I do both VirtualBox ATLAS and native ATLAS on LHC, and have a basis for comparison).

And the ram usage depends mainly on the project. It is reasonable enough (about 2 GB) when running 4 cores on Cosmology. If that is too much for you, then upgrade your hardware or stop hassling other people that do have it.

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49481 - Posted: 15 May 2018 | 15:50:04 UTC

We talked with the devs. The idea is to collaborate over summer for a Windows version. So I hope by the end of summer we should have a new release.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49483 - Posted: 15 May 2018 | 16:12:02 UTC - in response to Message 49481.

We talked with the devs. The idea is to collaborate over summer for a Windows version. So I hope by the end of summer we should have a new release.


Great news!!
Meantime, please fix problems with linux

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49493 - Posted: 17 May 2018 | 15:36:15 UTC

All CPU tasks fail on my SuSE Linux Leap 42.3. All GPU tasks complete and validate on my GTX 750 Ti giving me huge credits, more than Einstein@home and SETI@home GPU tasks.
Tullio

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49494 - Posted: 17 May 2018 | 16:42:19 UTC - in response to Message 49493.
Last modified: 17 May 2018 | 16:42:39 UTC

All CPU tasks fail on my SuSE Linux Leap 42.3. All GPU tasks complete and validate on my GTX 750 Ti giving me huge credits, more than Einstein@home and SETI@home GPU tasks.
Tullio

Hi, Credits cannot be compared from project to project. And even though GPU tasks give so much credit here at GPUGrid there is still substantial scientific weight and benefit to GPUGrid's CPU Work Units even though they don't give as much credit. Please keep this in mind.

Richard Haselgrove
Send message
Joined: 11 Jul 09
Posts: 1576
Credit: 5,602,161,851
RAC: 8,766,393
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49495 - Posted: 17 May 2018 | 18:17:15 UTC - in response to Message 49494.

All CPU tasks fail on my SuSE Linux Leap 42.3. All GPU tasks complete and validate on my GTX 750 Ti giving me huge credits, more than Einstein@home and SETI@home GPU tasks.
Tullio

Hi, Credits cannot be compared from project to project. And even though GPU tasks give so much credit here at GPUGrid there is still substantial scientific weight and benefit to GPUGrid's CPU Work Units even though they don't give as much credit. Please keep this in mind.

Since BOINC credits are defined as a certain number of 'cobblestones' (completed floating point operations), they should be comparable. But I agree, they're not.

That somewhat arcane point becomes more significant when statistics sites, and BOINC itself, back-calculate the floating point performance of a project from the number of credits awarded.

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49499 - Posted: 18 May 2018 | 3:58:40 UTC - in response to Message 49494.
Last modified: 18 May 2018 | 3:59:05 UTC


Hi, Credits cannot be compared from project to project. And even though GPU tasks give so much credit here at GPUGrid there is still substantial scientific weight and benefit to GPUGrid's CPU Work Units even though they don't give as much credit. Please keep this in mind.

I don't give a damn about credits. But all my CPU tasks fail miserably.
Tullio

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 49504 - Posted: 19 May 2018 | 3:07:28 UTC - in response to Message 49408.

We are losing CPU Volunteers, can anyone help?


If admins want CPU support they'll make an app w/o bugs. No effort by them, no effort from us. They get paid, we pay for the PCs and we'd rather not have it aimlessly wasted.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49514 - Posted: 21 May 2018 | 12:17:04 UTC - in response to Message 49504.

We are losing CPU Volunteers, can anyone help?


If admins want CPU support they'll make an app w/o bugs. No effort by them, no effort from us.


+1

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49515 - Posted: 21 May 2018 | 13:57:21 UTC - in response to Message 49504.

I would put up with the bugs if I could. But I get only crashes on QC now, so I am out of business.

I hope they make a big announcement when it is fixed, since I won't know about it otherwise. Maybe they are spending their time on the Windows version?

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 49516 - Posted: 21 May 2018 | 14:03:43 UTC

Maybe they are more interested to the results of the CRUNCHATHLON competition. You can not compete with a dead horse.
Tullio

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49517 - Posted: 21 May 2018 | 14:10:03 UTC - in response to Message 49516.

You can not compete with a dead horse.
Tullio

Not at the Palio either.

Toni
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 9 Dec 08
Posts: 1006
Credit: 5,068,599
RAC: 0
Level
Ser
Scientific publications
watwatwatwat
Message 49521 - Posted: 22 May 2018 | 14:21:27 UTC - in response to Message 49517.

Please see the Number Crunching forum.

Ken_g6
Send message
Joined: 6 Aug 11
Posts: 8
Credit: 52,496,994
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwat
Message 49578 - Posted: 1 Jun 2018 | 0:37:05 UTC

Well, I gave QM a try, but I really didn't like it, for a few reasons.

First, the setup doesn't work when running more than one WU at a time. You need a "lock file" to ensure only one thread does the setup. If that thread gets aborted you might have problems, but it's better than the current situation.

Second, you know what I hate? I hate BOINC apps that download more data themselves. (Such as LHC@Home Atlas.) All necessary data should be coming from your BOINC server. At least your app only seems to do that downloading once.

Third, you know what else I hate? Bloated apps. Your "miniconda" includes such things as TK (not needed unless there's a screen saver?) and man pages. Maybe if you streamlined it you could fit whatever extra data it downloads in the initial download, and then you wouldn't need the networking libraries either.

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49579 - Posted: 1 Jun 2018 | 0:43:40 UTC - in response to Message 49578.

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.

I don't care about credits themselves, but I do wonder about the science that is being accomplished. If it is the same per work unit, that is OK, but if it is being cut in half periodically also, then that is a problem. I wonder what causes it?

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49580 - Posted: 1 Jun 2018 | 11:27:36 UTC - in response to Message 49578.
Last modified: 1 Jun 2018 | 11:37:39 UTC

But, I finally did get QM working. What made me give up on it was the credit. It started around 600 credits/WU, but it seemed to get cut in half every few sets of WUs. It was down around 50 when I gave up.

The credits are down to around 50 right now because the Work Units are extremely short due to testing.

I'm not sure what everyone's fantasy is with credit. I personally couldn't care less as long as what I am doing is benefiting science. The credit itself is worth nothing so I'm not sure I get the point. I guess some people just need something more.

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49581 - Posted: 1 Jun 2018 | 14:11:22 UTC
Last modified: 1 Jun 2018 | 14:44:33 UTC

Indeed as papalito said these WUs are muuuuuch shorter than the 600 credits ones. They scale by computation time automatically. I miscalculated a bit yesterday how fast they are so we ran out but I'm going to submit more in an hour or so.

The downloading stuff I understand but we depend unfortunately on external software (psi4) so we cannot control everything. As you said it only downloads once. But yes conda is bloated in general but we kept it down to the bare minimum packages.

@Jim the WUs that I send contain varying molecules of different number of atoms. The ones I sent yesterday had very few atoms so they completed super fast. But "every molecule is sacred" as per Monty Python. I guess I could mix all molecules together but it would become an organizational chaos for me to keep track of what I have already calculated, so for now I will continue submitting them with increasing molecule size.

klepel
Send message
Joined: 23 Dec 09
Posts: 189
Credit: 4,196,461,293
RAC: 1,617,116
Level
Arg
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49582 - Posted: 1 Jun 2018 | 14:55:59 UTC

Stefan, Can you reduce free disk-space requirement of 4768.37 MB to something like 4000MB or less? Your QM WUs do not fit on my USB 16 GB Stick anymore! (After Lubuntu Up-Grade from 17.10 to 18.04)

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49583 - Posted: 1 Jun 2018 | 15:13:14 UTC - in response to Message 49582.

Sorry klepel, I don't think I can :( Most of it is taken up by miniconda and the required software, not the workunits themselves.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49584 - Posted: 1 Jun 2018 | 23:22:09 UTC - in response to Message 49581.

@Jim the WUs that I send contain varying molecules of different number of atoms. The ones I sent yesterday had very few atoms so they completed super fast. But "every molecule is sacred" as per Monty Python. I guess I could mix all molecules together but it would become an organizational chaos for me to keep track of what I have already calculated, so for now I will continue submitting them with increasing molecule size.

No problem at all. Keep doing what you have to do.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49585 - Posted: 3 Jun 2018 | 1:24:25 UTC

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49587 - Posted: 3 Jun 2018 | 9:30:46 UTC - in response to Message 49193.


When can we expect some info about scientific results created with this app?


Months away, we have just started.



Some months have gone.
We are crunching for....? Cancer research? Any preliminary result?
Do you plan, togheter with windows app, also a gpu version?

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49588 - Posted: 3 Jun 2018 | 9:31:53 UTC - in response to Message 49585.

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?


+1

STARBASEn
Avatar
Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 49589 - Posted: 3 Jun 2018 | 17:41:19 UTC - in response to Message 49588.

+ another 1. I have 7+7+3 cores 100% dedicated to QC and 4+4+4 cores 50% dedicated to QC and WCG, all 24/7. Along with 3 GTX 1060's, makes for a very warm office, especially now in summer. Would be interesting to find out what the project goals are :).

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 7,520
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49590 - Posted: 3 Jun 2018 | 21:11:31 UTC - in response to Message 49585.

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?

See the "New Student and QMML Project" thread for a clue.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49594 - Posted: 4 Jun 2018 | 7:50:57 UTC - in response to Message 49590.

@Stefan can you quickly describe for us what the Quantum Chemistry Work Units are doing and what you are learning from these work units?

See the "New Student and QMML Project" thread for a clue.


Really a "clue".
"We are simulating molecules". Ok, very precise :-P

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49595 - Posted: 4 Jun 2018 | 13:11:08 UTC
Last modified: 4 Jun 2018 | 13:23:27 UTC

Yeah sorry. I've developed a partially healthy paranoia over the last years due to some researchers being unhealthily competitive. In this case I'm trying to steer away from what others do to avoid problems but I'll be a bit vague anyway just to be safe.

Practically we are trying to teach a neural network to calculate molecular energies and forces. QM calculations are horribly slow and scale quadratically to the number of atoms. But a network trained on QM data is orders of magnitude faster, scales linearly with the numbers of atoms and achieves decently good accuracy. We believe these networks are the future for molecular simulations so we try to work with them and see what problems we can apply them to. At the moment they are still slower than usual MD simulations which we used to do but they should be much more accurate given enough training data. This training data is what is critical and what we are trying to produce currently.

Currently there are already three or so groups working on such networks and they have shown great results so we try to mostly collaborate with them to avoid duplication of effort and clash of research topics.
If you want to read up on some great projects that inspired us, check out ANI1 https://arxiv.org/abs/1610.08935 TensorMol https://arxiv.org/abs/1711.06385 DeepMD https://arxiv.org/abs/1712.03641

On applications to more biological research and implications to disease related research you will have to wait for my publication :)

kain
Send message
Joined: 3 Sep 14
Posts: 152
Credit: 641,182,245
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwat
Message 49596 - Posted: 4 Jun 2018 | 14:57:41 UTC

Very interesting, thank you :)

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49597 - Posted: 4 Jun 2018 | 16:05:50 UTC - in response to Message 49595.

Thank you!!

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49598 - Posted: 4 Jun 2018 | 18:58:20 UTC

Thank you for sharing more info Stefan!

STARBASEn
Avatar
Send message
Joined: 17 Feb 09
Posts: 91
Credit: 1,603,303,394
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 49599 - Posted: 4 Jun 2018 | 22:02:49 UTC

Yes, thank you, much appreciated.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49600 - Posted: 4 Jun 2018 | 23:15:48 UTC - in response to Message 49595.

Practically we are trying to teach a neural network to calculate molecular energies and forces.

As you well know, the new Nvidia cards are said to be designed for "deep learning". Maybe that will be of some use to you someday.

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49601 - Posted: 5 Jun 2018 | 7:44:18 UTC - in response to Message 49600.

Yes, these quantum chemistry potential networks are a deep learning application :) So we train them on our local NVIDIA GPUs. But for the moment I don't see a need to distribute the training of the networks to GPUGRID if that's what you meant. It trains fast enough locally.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49602 - Posted: 5 Jun 2018 | 10:35:45 UTC - in response to Message 49601.

OK, that gives me a better idea of how we fit into the overall scheme of things. I am glad we can do that work for you.

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49603 - Posted: 5 Jun 2018 | 11:16:50 UTC

Thank you for answering my questions Stefan.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 49604 - Posted: 5 Jun 2018 | 11:47:24 UTC

I've been running the GPU tasks on a 3570k (along side some other projects) on Ubuntu 14.04, just 4 threads so no chance of the simultaneous start issue. All good so far.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49605 - Posted: 5 Jun 2018 | 13:08:28 UTC - in response to Message 49601.
Last modified: 5 Jun 2018 | 13:08:41 UTC

So we train them on our local NVIDIA GPUs. But for the moment I don't see a need to distribute the training of the networks to GPUGRID if that's what you meant. It trains fast enough locally.


I cannot understand.
Are we crunching GpuGrid QM to "prepare" data for your local/internal GPU?

Stefan
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 5 Mar 13
Posts: 348
Credit: 0
RAC: 0
Level

Scientific publications
wat
Message 49606 - Posted: 5 Jun 2018 | 14:01:16 UTC - in response to Message 49605.
Last modified: 5 Jun 2018 | 14:01:56 UTC

Hm ok, maybe you are not familiar with machine learning. Sorry if I glossed over it. In machine learning and specifically supervised learning as in this project you "teach" a network to replicate some ground-truth calculations (in this case QM energy/force calculations).

This means that we take some molecules, position their atoms in 3D space and you guys calculate with QM the energy and forces of this conformation of this molecule.

Then I locally on my computer show a network only the positions of the atoms in space and ask it to predict the energy and forces that you calculated for us (from the QM). This might sound pointless because why are you predicting stuff you already know? Well the great thing about networks is that they are very good interpolators, so if I now give it a molecule (more or less) similar to the ones it was trained on and ask it what is the energy of this molecule, the network will give me an incredibly good estimate of the energy/forces in a few microseconds while with QM I might need minutes to do the same.

Does this clarify it?

PappaLitto
Send message
Joined: 21 Mar 16
Posts: 511
Credit: 4,617,042,755
RAC: 0
Level
Arg
Scientific publications
watwatwatwatwatwatwatwat
Message 49607 - Posted: 5 Jun 2018 | 18:30:10 UTC - in response to Message 49606.

Thank you Stefan, this is a fantastic explanation!

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,481,959
RAC: 6,443,617
Level
Arg
Scientific publications
watwatwatwatwat
Message 49608 - Posted: 6 Jun 2018 | 1:44:43 UTC - in response to Message 49607.

+1

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 49619 - Posted: 6 Jun 2018 | 13:18:37 UTC - in response to Message 49606.

Does this clarify it?


Very, very clear.
Thank you!!

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49729 - Posted: 27 Jun 2018 | 16:28:14 UTC - in response to Message 49606.

For some reason, that approach appeals to me a lot as an ideal distributed computing project. It allows you to offload the slow calculations, while you retain the flexibility of asking a lot of different questions on the returned data that you can investigate with your high-speed calculations. It does not appear to require excessive bandwidth to shuttle the data back and forth (though I have a lot if needed), nor does it require a lot of memory (though I have plenty of that too if you need it).

Also, it does not appear to be tied to a particular type of molecule or disease, but should lend itself to a wide range of subjects. And lastly, aside from a few startup glitches, it seems to be reliable on home computers, and we need not constantly fight to keep it running in the face of errors or crashes. I hope, and expect, that you will achieve significant success with it.

Tomas Brada
Send message
Joined: 3 Nov 15
Posts: 38
Credit: 6,768,093
RAC: 0
Level
Ser
Scientific publications
wat
Message 50855 - Posted: 11 Nov 2018 | 18:47:01 UTC

I am running QC on my box currently and there does not appear any startup glitches. It can run two and it can start multiple at the same time. I see there is some usage of flock in the app, and that seems to solve the startup crashes that everyone is complaining. So, Good job.
Pity that there are no more amd gpu tasks, after I acquired two such gpus.
____________

Darth_Chippo
Send message
Joined: 7 Oct 16
Posts: 9
Credit: 585,646,651
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwat
Message 51418 - Posted: 3 Feb 2019 | 7:25:15 UTC

No Chems for me;)
The GPU-WU runs best under my Win7 64 bit-System (Xeon e3-1230 v2 + NVIDIA GTX 1050 +8 Gig RAM).
So, over VMWare 14 Ubuntu 18.04 with newest boinc-client (4 cores, 4 Gig ram, 100 gig HD-Space). No Quantum Chemistry available, he says. Solutions?
Sorry, long night, no patience. Say me i have forget some infos.

Profile ServicEnginIC
Avatar
Send message
Joined: 24 Sep 10
Posts: 566
Credit: 5,939,877,024
RAC: 10,921,268
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51419 - Posted: 3 Feb 2019 | 14:58:47 UTC

So, over VMWare 14 Ubuntu 18.04 with newest boinc-client (4 cores, 4 Gig ram, 100 gig HD-Space). No Quantum Chemistry available, he says. Solutions?


When I started processing QC WUs, I had to configure GPUGrid preferences to use CPU and accept QC tasks.
Then, I had to upgrade several of my Linux sytems from 4 to 8 GB RAM.
4 GB Systems didn't get QC WUs. This seems to be your problem.
And I also had to upgrade two systems with 64 GB SSDs to bigger sizes because a lack of HD space.
You're wellcome. Good Luck!

Darth_Chippo
Send message
Joined: 7 Oct 16
Posts: 9
Credit: 585,646,651
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwat
Message 51420 - Posted: 3 Feb 2019 | 19:23:45 UTC

mmmh, i think i can upgrade ram to 16 GB. CPU, QC allowed. You think, the ram is the problem... not the virtualmachine self?

Profile ServicEnginIC
Avatar
Send message
Joined: 24 Sep 10
Posts: 566
Credit: 5,939,877,024
RAC: 10,921,268
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51421 - Posted: 3 Feb 2019 | 19:56:42 UTC

For sure, Quantum Chemistry WUs won't be sent to 4 GB RAM systems.
Also, BOINC Client must "think" VirtualBox is installed.
BOINC Manager log should show similar to last line in this example, coming from one of my systems running QC WUs successfully...

Sun 03 Feb 2019 19:37:31 WET | | Starting BOINC client version 7.6.31 for x86_64-pc-linux-gnu
Sun 03 Feb 2019 19:37:31 WET | | log flags: file_xfer, sched_ops, task
Sun 03 Feb 2019 19:37:31 WET | | Libraries: libcurl/7.47.0 OpenSSL/1.0.2g zlib/1.2.8 libidn/1.32 librtmp/2.3
Sun 03 Feb 2019 19:37:31 WET | | Data directory: /var/lib/boinc-client
Sun 03 Feb 2019 19:37:31 WET | | CUDA: NVIDIA GPU 0: GeForce GTX 1050 Ti (driver version 415.27, CUDA version 10.0, compute capability 6.1, 4032MB, 3613MB available, 2138 GFLOPS peak)
Sun 03 Feb 2019 19:37:31 WET | | OpenCL: NVIDIA GPU 0: GeForce GTX 1050 Ti (driver version 415.27, device version OpenCL 1.2 CUDA, 4032MB, 3613MB available, 2138 GFLOPS peak)
Sun 03 Feb 2019 19:37:32 WET | | Host name: ServicEnginIC
Sun 03 Feb 2019 19:37:32 WET | | Processor: 4 GenuineIntel Intel(R) Core(TM)2 Quad CPU Q9550 @ 2.83GHz [Family 6 Model 23 Stepping 10]
Sun 03 Feb 2019 19:37:32 WET | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl cpuid aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_lm pti tpr_shadow vnmi flexpriority dtherm
Sun 03 Feb 2019 19:37:32 WET | | OS: Linux: 4.15.0-43-generic
Sun 03 Feb 2019 19:37:32 WET | | Memory: 7.79 GB physical, 16.00 GB virtual
Sun 03 Feb 2019 19:37:32 WET | | Disk: 424.24 GB total, 256.27 GB free
Sun 03 Feb 2019 19:37:32 WET | | Local time is UTC +0 hours
Sun 03 Feb 2019 19:37:32 WET | | VirtualBox version: 5.1.38_Ubuntur122592
.
.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51422 - Posted: 3 Feb 2019 | 20:52:41 UTC - in response to Message 51421.
Last modified: 3 Feb 2019 | 20:54:47 UTC

Also, BOINC Client must "think" VirtualBox is installed.

I have not found VirtualBox to be necessary. My present machine, a Ryzen 2600 (Ubuntu 18.04.1) does not have it installed.

Ryzen2600

1 2/2/2019 9:38:37 PM Starting BOINC client version 7.14.2 for x86_64-pc-linux-gnu
2 2/2/2019 9:38:37 PM log flags: file_xfer, sched_ops, task
3 2/2/2019 9:38:37 PM Libraries: libcurl/7.58.0 OpenSSL/1.1.0g zlib/1.2.11 libidn2/2.0.4 libpsl/0.19.1 (+libidn2/2.0.4) nghttp2/1.30.0 librtmp/2.3
4 2/2/2019 9:38:37 PM Data directory: /var/lib/boinc-client
5 2/2/2019 9:38:37 PM CUDA: NVIDIA GPU 0: GeForce GTX 750 Ti (driver version 390.77, CUDA version 9.1, compute capability 5.0, 2001MB, 1937MB available, 1472 GFLOPS peak)
6 2/2/2019 9:38:37 PM [libc detection] gathered: 2.27, Ubuntu GLIBC 2.27-3ubuntu1
7 2/2/2019 9:38:37 PM Host name: Ryzen2600
8 2/2/2019 9:38:37 PM Processor: 12 AuthenticAMD AMD Ryzen 5 2600 Six-Core Processor [Family 23 Model 8 Stepping 2]
9 2/2/2019 9:38:37 PM Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor
10 2/2/2019 9:38:37 PM OS: Linux Ubuntu: Ubuntu 18.04.1 LTS [4.15.0-43-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]
11 2/2/2019 9:38:37 PM Memory: 15.66 GB physical, 1.86 GB virtual
12 2/2/2019 9:38:37 PM Disk: 411.52 GB total, 377.77 GB free
13 2/2/2019 9:38:37 PM Local time is UTC -5 hours
14 GPUGRID 2/2/2019 9:38:37 PM Found app_config.xml
15 Rosetta@home 2/2/2019 9:38:37 PM Found app_config.xml
16 2/2/2019 9:38:37 PM Config: allow multiple clients
17 2/2/2019 9:38:37 PM Config: GUI RPC allowed from any host
18 2/2/2019 9:38:37 PM Config: GUI RPCs allowed from:
19 2/2/2019 9:38:37 PM 192.168.0.107
20 2/2/2019 9:38:37 PM Config: use all coprocessors
21 GPUGRID 2/2/2019 9:38:37 PM URL http://www.gpugrid.net/; Computer ID 497979; resource share 100

Profile ServicEnginIC
Avatar
Send message
Joined: 24 Sep 10
Posts: 566
Credit: 5,939,877,024
RAC: 10,921,268
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51423 - Posted: 3 Feb 2019 | 23:01:48 UTC
Last modified: 3 Feb 2019 | 23:07:56 UTC

I have not found VirtualBox to be necessary. My present machine, a Ryzen 2600 (Ubuntu 18.04.1) does not have it installed.


Yes, that's right.
VirtualBox is not necessary for QC WUs to run.
I mixed requirements for another of my CPU projects, LHC@Home... Excuse me ;-)

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51424 - Posted: 3 Feb 2019 | 23:38:19 UTC - in response to Message 51423.

I mixed requirements for another of my CPU projects, LHC@Home... Excuse me ;-)

I run both also; I usually just install it anyway.

Darth_Chippo
Send message
Joined: 7 Oct 16
Posts: 9
Credit: 585,646,651
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwat
Message 51425 - Posted: 4 Feb 2019 | 3:53:02 UTC

Good then a buy 8 GB extra. Hope the aged electrical capacitor from my over 5 year old mainboard get not killed...

Darth_Chippo
Send message
Joined: 7 Oct 16
Posts: 9
Credit: 585,646,651
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwat
Message 51426 - Posted: 4 Feb 2019 | 9:36:06 UTC - in response to Message 51425.

And now i am blind. Exist a Ubuntu 18.04.1 64 Bit i386-Version or im stupid to look?

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51427 - Posted: 4 Feb 2019 | 13:56:42 UTC - in response to Message 51426.

The "Desktop image" works for me on both AMD (Ryzen) and Intel (i7-8700).
Their description is a bit confusing though.
http://releases.ubuntu.com/18.04/

Plaka
Send message
Joined: 24 Apr 15
Posts: 3
Credit: 7,892,625
RAC: 0
Level
Ser
Scientific publications
wat
Message 51456 - Posted: 10 Feb 2019 | 9:40:34 UTC

Hi what is the requirement i have 4 go ram / i5-8400 on my linux. It ok ?

Witch is the command for helping ?

--project_attach http://www.gpugrid.net account_key ???


Thx
____________

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 51458 - Posted: 10 Feb 2019 | 13:27:05 UTC
Last modified: 10 Feb 2019 | 13:29:56 UTC

I installed a VirtualBox Linux on a Windows 10 PC but the BOINC Manager supplied by SuSE does not work. So I attached it to Einstein@home by a line command using the key I know. But I don't know the GPUGRID key. Also, I installed the nVidia driver for my GTX 750 board, but the Einstein client does not recognize it.
Tullio
____________

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 158
Credit: 388,132
RAC: 0
Level

Scientific publications
wat
Message 51459 - Posted: 10 Feb 2019 | 14:53:14 UTC - in response to Message 51458.

I installed a VirtualBox Linux on a Windows 10 PC but the BOINC Manager supplied by SuSE does not work.


I'm using Linux Mint 18.1(Serena) on my Win10 machine and it runs well with boinc and gpugrid

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 51460 - Posted: 10 Feb 2019 | 17:53:24 UTC - in response to Message 48820.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

If you give me your key I can make a manual connection from this Virtual Machine as I have done with Einstein@home. The SuSE BOINC manager does not work on the Virtual Machine. You can PM me.
Tullio

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51461 - Posted: 10 Feb 2019 | 20:02:32 UTC - in response to Message 51460.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

If you give me your key I can make a manual connection from this Virtual Machine as I have done with Einstein@home. The SuSE BOINC manager does not work on the Virtual Machine. You can PM me.
Tullio


I believe that's your weak account key listed on your GPUGrid account page.

boinccmd --project_attach project_url your_weak_account_key

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 51486 - Posted: 14 Feb 2019 | 11:08:56 UTC - in response to Message 48820.

Hi, we need more CPUs on Linux to run QM simulations. Anybody can help?

Just place your QM Linux app into a Virtualbox container to make it available for Windows clients in order to acquire the largest possible pool of machines - without significant add-on developmental needs.

Michael.
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 51487 - Posted: 14 Feb 2019 | 12:50:23 UTC
Last modified: 14 Feb 2019 | 12:51:19 UTC

Using vbox to get the most users is an oxymoron. The native Linux app already uses a lot of disk space as is.

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 51488 - Posted: 14 Feb 2019 | 14:22:42 UTC - in response to Message 51487.
Last modified: 14 Feb 2019 | 14:26:50 UTC

The native Linux app already uses a lot of disk space as is.

Disk space? Ehm, since when is disk space an issue in 2019? ;-)
RAM could indeed become an issue, though...

Just check the world-wide OS distribution, or even just within the BOINC community - then you know where the true bottle neck is hiding (not that I like it but, unfortunately, it's a fact...).

Michael.

P.S.: Anyway - I just saw that the VM approach had already been mentioned above. I should have read the thread more carefully this time, I guess... ;-)
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 51490 - Posted: 14 Feb 2019 | 16:06:23 UTC
Last modified: 14 Feb 2019 | 16:07:18 UTC

On my account page there is no key, either weak or strong. I have both Keys for all my projects, except GPUGRID. I have installed SuSE Linux Leap 15.0 on a Windows 10 PC with Home edition 1809. Then I accepted an update from SuSE and found myself with the Tumbleweed version of SuSE Linux, which is a development version. I connected it manually to Einstein@home, since its BOINC manager does not work.

Tullio
____________

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51491 - Posted: 14 Feb 2019 | 16:33:52 UTC - in response to Message 51490.
Last modified: 14 Feb 2019 | 16:34:28 UTC

On my account page there is no key, either weak or strong.
Tullio


On the top left quadrant of my GPUGrid account page is where I see my weak account key (bold). If you don't have one then I'm not sure what the problem is with your account.

Account information
Name
Email address
Country United States
Postal code
GPUGRID member since 26 Aug 2008
Change email address | password | other account info
User ID
Used in community function
Weak account key
Provides limited access to your account

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 51494 - Posted: 14 Feb 2019 | 18:35:48 UTC - in response to Message 51488.
Last modified: 14 Feb 2019 | 18:36:34 UTC

The native Linux app already uses a lot of disk space as is.

Disk space? Ehm, since when is disk space an issue in 2019? ;-)
RAM could indeed become an issue, though...

Just check the world-wide OS distribution, or even just within the BOINC community - then you know where the true bottle neck is hiding (not that I like it but, unfortunately, it's a fact...).

Michael.

P.S.: Anyway - I just saw that the VM approach had already been mentioned above. I should have read the thread more carefully this time, I guess... ;-)


30-60GB per task! Times 8 on a 32t BOINC only machine surely adds up. I don't have disk space for that. Multiple people here went out and purchased larger hard drives just for this app. I try to put SSDs in machines and not something like a 1TB for a BOINC only PC.

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 51502 - Posted: 16 Feb 2019 | 10:19:49 UTC - in response to Message 51494.

30-60GB per task! Times 8 on a 32t BOINC only machine surely adds up. I don't have disk space for that. Multiple people here went out and purchased larger hard drives just for this app. I try to put SSDs in machines and not something like a 1TB for a BOINC only PC.

Well, I guess I need to check that on my QM machine: Of course, 30-60 GB per task would indeed be a lot.

Still, I do not understand what exactly should be "oxymoron" in allowing Windows users to ADD to the existing Linux participant pool by simply employing a Virtualbox-based approach where the existing Linux client is wrapped in a virtual Linux machine. For you, nothing would change.

Michael.
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 51505 - Posted: 16 Feb 2019 | 13:59:55 UTC

Using vbox is the opposite of being able to reach the majority of users. Projects with vbox only apps have a much lower participation rate compared to other BOINC projects.

rbpeake
Send message
Joined: 30 Jul 08
Posts: 17
Credit: 80,343,188
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwat
Message 51508 - Posted: 16 Feb 2019 | 20:23:19 UTC

I am running Linux Mint in an Oracle VirtualBox.

I have 108 GB of storage in the VB, but I keep getting the following message in Boinc:

Sat Feb 16 20:10:08 2019 | GPUGRID | Message from server: Quantum Chemistry needs 54846.23MB more disk space. You currently have 2374.23 MB available and it needs 57220.46 MB.

Is there any way to fix this?

Thanks!

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51509 - Posted: 16 Feb 2019 | 22:33:30 UTC - in response to Message 51508.

Boinc Manager: options/computing preference/disk/memory tab.

Disk space check boxes:

"leave at least" 5 GB free

"use no more than " 95%

It looks like your VM is set up with only 1 processor core. Ideally you'd want 4 cores for the VM since this is a multi-thread app (4 cores per task).

Has anyone got this working with a linux VM on windows?

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 51514 - Posted: 17 Feb 2019 | 11:34:39 UTC - in response to Message 51505.

Using vbox is the opposite of being able to reach the majority of users. Projects with vbox only apps have a much lower participation rate compared to other BOINC projects.

Ehm, once again: The Virtualbox Windows-only users would simply ADD to the existing Linux user pool. To my knowledge there is till no functional Windows CPU app.

Michael.
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

Erich56
Send message
Joined: 1 Jan 15
Posts: 1090
Credit: 6,603,906,926
RAC: 21,893,126
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwat
Message 51517 - Posted: 17 Feb 2019 | 13:45:41 UTC - in response to Message 51514.

...To my knowledge there is still no functional Windows CPU app.

unfortunately, you are perfectly right :-(

captainjack
Send message
Joined: 9 May 13
Posts: 171
Credit: 2,322,454,288
RAC: 2,372,707
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51518 - Posted: 17 Feb 2019 | 14:53:31 UTC

biodoc asked:

Has anyone got this working with a linux VM on windows?

Yes, I have two machines set up that I use occasionally, 489909 and 490622. Host O/S is Windows 10 Home, guest O/S is Ubuntu 18.10.

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51519 - Posted: 17 Feb 2019 | 16:13:40 UTC - in response to Message 51518.

Yes, I have two machines set up that I use occasionally, 489909 and 490622. Host O/S is Windows 10 Home, guest O/S is Ubuntu 18.10.


Thanks captainjack. It's good to know that's a working option for windows users until the native app is released.

rbpeake
Send message
Joined: 30 Jul 08
Posts: 17
Credit: 80,343,188
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwat
Message 51522 - Posted: 18 Feb 2019 | 14:18:45 UTC - in response to Message 51519.

Yes, I have two machines set up that I use occasionally, 489909 and 490622. Host O/S is Windows 10 Home, guest O/S is Ubuntu 18.10.


Thanks captainjack. It's good to know that's a working option for windows users until the native app is released.

Using Ubuntu worked! It did not limit the amount of disk space shown in Boinc when the VM had much more.
Thanks!

tullio
Send message
Joined: 8 May 18
Posts: 190
Credit: 104,426,808
RAC: 0
Level
Cys
Scientific publications
wat
Message 51533 - Posted: 20 Feb 2019 | 19:31:18 UTC - in response to Message 51491.
Last modified: 20 Feb 2019 | 19:32:31 UTC


On the top left quadrant of my GPUGrid account page is where I see my weak account key (bold). If you don't have one then I'm not sure what the problem is with your account.

Account information
Name
Email address
Country United States
Postal code
GPUGRID member since 26 Aug 2008
Change email address | password | other account info
User ID
Used in community function
Weak account key
Provides limited access to your account


I have only
User ID
GPUGRID member since
Country
Total credit
Recent average credit
Computers

I solved the problem by connecting with a slower computer where BOINC Manager works
Tullio
____________

Profile Michael H.W. Weber
Send message
Joined: 9 Feb 16
Posts: 71
Credit: 607,916,391
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwat
Message 51576 - Posted: 26 Feb 2019 | 11:10:24 UTC - in response to Message 51494.

30-60GB per task! Times 8 on a 32t BOINC only machine surely adds up. I don't have disk space for that. Multiple people here went out and purchased larger hard drives just for this app. I try to put SSDs in machines and not something like a 1TB for a BOINC only PC.

Well, as announced before, I have checked this and I beg to differ but on my i7 octacore machine (hyperthreading active), GPUGRID occupies no more than a total disk space of 4.92 GB - and it continuously works with 6 cores on 2 MT GPUGRID QM work units.

Michael.
____________
President of Rechenkraft.net - Germany's first and largest distributed computing organization.

mmonnin
Send message
Joined: 2 Jul 16
Posts: 332
Credit: 3,772,896,065
RAC: 4,765,302
Level
Arg
Scientific publications
watwatwatwatwat
Message 51577 - Posted: 26 Feb 2019 | 15:40:32 UTC - in response to Message 51576.
Last modified: 26 Feb 2019 | 15:40:50 UTC

30-60GB per task! Times 8 on a 32t BOINC only machine surely adds up. I don't have disk space for that. Multiple people here went out and purchased larger hard drives just for this app. I try to put SSDs in machines and not something like a 1TB for a BOINC only PC.

Well, as announced before, I have checked this and I beg to differ but on my i7 octacore machine (hyperthreading active), GPUGRID occupies no more than a total disk space of 4.92 GB - and it continuously works with 6 cores on 2 MT GPUGRID QM work units.

Michael.


A quote from a prior post in this thread.

Sat Feb 16 20:10:08 2019 | GPUGRID | Message from server: Quantum Chemistry needs 54846.23MB more disk space. You currently have 2374.23 MB available and it needs 57220.46 MB.


The admin has said production tasks would need ~60GB. The 30Gb # was for Beta tasks. I don't run these, but others have reported needing large amounts of disk for these.

Matt Kowal
Avatar
Send message
Joined: 27 May 14
Posts: 9
Credit: 92,568,568
RAC: 0
Level
Thr
Scientific publications
watwat
Message 51579 - Posted: 28 Feb 2019 | 22:14:37 UTC

These WUs are all multi-threaded, yes? Do they require a certain number of threads >1?

Jim1348
Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51580 - Posted: 28 Feb 2019 | 23:00:13 UTC
Last modified: 28 Feb 2019 | 23:21:05 UTC

They are no longer doing the "monster" ones, either 30 GB or 60 GB.
http://www.gpugrid.net/forum_thread.php?id=4785&nowrap=true#51272

I am seeing a project folder size of only 2.1 GB, even when running 10 work units on my i7-8700, and the slots folder adds another 3.4 GB, where I think they would run.

biodoc
Send message
Joined: 26 Aug 08
Posts: 183
Credit: 6,493,864,375
RAC: 2,796,812
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 51581 - Posted: 1 Mar 2019 | 9:46:37 UTC - in response to Message 51579.
Last modified: 1 Mar 2019 | 9:47:23 UTC

These WUs are all multi-threaded, yes? Do they require a certain number of threads >1?


Yes, they are multi-threaded and the default is 4 threads per task. You can limit the number of tasks running by using an app_config.xml with <max_concurrent>x</max_concurent> line. I'm running nine 4 thread tasks concurrently on a 40 thread machine using the the following app_config.xml.

<app>
<name>QC</name>
<max_concurrent>9</max_concurrent>
</app>
<app_version>
<app_name>QC</app_name>
<plan_class>mt</plan_class>
<avg_ncpus>4</avg_ncpus>
<cmdline>--nthreads 4</cmdline>
</app_version>
</app_config>

Post to thread

Message boards : News : CPU jobs on Linux

//