immortal old rendered tasks files

16 replies [Last post]
User offline. Last seen 2 days 6 hours ago. Offline
Fellow
Joined: 2009-08-13

why are the already rendered tasks files not removed from the clients ? If deleted manualy, the server resends them, although they are no longer neded !

If unattended, in time they will occupy a lot of space! And i don't like that :)-

jbk
User offline. Last seen 4 days 12 hours ago. Offline
BURP Ninja
Joined: 2008-10-05
That's certainly a bug. The

The session files are supposed to remain on your machine only for as long as the given session is rendering so this may be a bug. Unfortunately if this is a bug it is located somewhere inside the server backend, so it may take a little while to find it and fix it.

What diskspace settings do you use for the client?

User offline. Last seen 2 days 6 hours ago. Offline
Fellow
Joined: 2009-08-13
Disk and memory usage Use at

Disk and memory usage
Use at most 9 GB disk space
Leave at least
(Values smaller than 0.001 are ignored) 0.5 GB disk space free
Use at most 80% of total disk space
Write to disk at most every 60 seconds
Use at most 75% of page file (swap space)
Use at most
Enforced by version 5.8+ 75% of memory when computer is in use
Use at most
Enforced by version 5.8+ 75% of memory when computer is not in use

how small should the disk space availible be ? (if this is the reason, though i doubt it !)
if it matters, the machine is running linux (ubuntu).

is this happening only on my machine or to everbody ?

jbk
User offline. Last seen 4 days 12 hours ago. Offline
BURP Ninja
Joined: 2008-10-05
Do the files stay if you hit

Do the files stay if you hit "reset project" on the client? (please note that this will abort any running workunits, so do it when you don't have a lot running...)

User offline. Last seen 2 days 6 hours ago. Offline
Fellow
Joined: 2009-08-13
if i press reset project,

if i press reset project, only the application files get deleted, the "blend" files remain.

If i delete them manually ... then :

Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file155162 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file156057 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file156054 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file168057 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file167995 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file169941 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file171007 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file171254 not found
Vi 16 oct 2009 23:42:57 +0300 file projects/www.renderfarm.fi/file192855 not found
Vi 16 oct 2009 23:42:58 +0300 Open Rendering Environment Started download of file155162
Vi 16 oct 2009 23:42:58 +0300 Open Rendering Environment Started download of file156057
Vi 16 oct 2009 23:43:06 +0300 Open Rendering Environment Finished download of file155162
Vi 16 oct 2009 23:43:06 +0300 Open Rendering Environment Started download of file156054
Vi 16 oct 2009 23:43:16 +0300 Open Rendering Environment Finished download of file156054
Vi 16 oct 2009 23:43:16 +0300 Open Rendering Environment Started download of file168057
Vi 16 oct 2009 23:43:53 +0300 Open Rendering Environment Finished download of file168057
Vi 16 oct 2009 23:43:53 +0300 Open Rendering Environment Started download of file167995
Vi 16 oct 2009 23:44:16 +0300 Open Rendering Environment Finished download of file167995
Vi 16 oct 2009 23:44:16 +0300 Open Rendering Environment Started download of file169941
Vi 16 oct 2009 23:44:39 +0300 Open Rendering Environment Finished download of file169941
Vi 16 oct 2009 23:44:39 +0300 Open Rendering Environment Started download of file171007
Vi 16 oct 2009 23:44:53 +0300 Open Rendering Environment Finished download of file171007
Vi 16 oct 2009 23:44:53 +0300 Open Rendering Environment Started download of file171254
Vi 16 oct 2009 23:45:08 +0300 Open Rendering Environment Finished download of file171254
Vi 16 oct 2009 23:45:08 +0300 Open Rendering Environment Started download of file192855
Vi 16 oct 2009 23:45:39 +0300 Open Rendering Environment Finished download of file192855
Vi 16 oct 2009 23:45:54 +0300 Open Rendering Environment Finished download of file156057

 ... so i doubt that the issue is on the client side ...

User offline. Last seen 4 weeks 4 days ago. Offline
Believer
Joined: 2008-11-14
the problem is still there...

the problem is still there... i don't want to detach project only for cleaning up the data directory.

User offline. Last seen 2 days 6 hours ago. Offline
Fellow
Joined: 2009-08-13
@baracutio   go see

@baracutio   go see http://www.renderfarm.fi/forum/post/2372

definitely an annoying issue, but i guess we can go around it for now ...

User offline. Last seen 3 weeks 2 days ago. Offline
Project administrator
Joined: 2008-11-26
We'll have to figure out a fix to this issue

I apologize for this issue. Right now we're tackling the issue of checkpointing (saving render state) on the client. When this work is finished and tested I'll make sure we put resources to finding a way to eliminate this problem.

Julius Tuomisto Project Administrator Laurea SID Networks, Espoo, Finland Tel. +358-50-4135412

User offline. Last seen 25 min 4 sec ago. Offline
Fellow
Joined: 2010-05-31
Immortal Files

Checkpointing is definately more important. Stay focused on that feature. Does that include properly suspending blender when a task is suspended in BOINC?

For the file deletions. I've noticed it happens only if your client has worked on a workunit in the past. A client won't download old files if they haven't participated in the session.

It seems like burp doesn't have this problem (as much) because the old results are deleted after a while(?). It there a reason to keep the old results? Would it free up much disk space (preventing another meltdown)?

User offline. Last seen 4 weeks 4 days ago. Offline
Believer
Joined: 2008-11-14
i had a closer look at the

i had a closer look at the boinc data dir. there is a file named sched_request_www.renderfarm.fi.xml. in it you can find entries like this:

<file_info>
<name>file377932</name>
<nbytes>823040.000000</nbytes>
<status>1</status>
<report_on_rpc />
</file_info>

so if i remove these file_info entries and delete the input files manually they shouldn't come back, right?

 

EDIT: it works:)

User offline. Last seen 2 days 6 hours ago. Offline
Fellow
Joined: 2009-08-13
hmmm something is still fishy

hmmm something is still fishy ...

i did the file_info removal, deleted all contents of the project folder, and yes it did not download the .blend files.(but the backend of the server is currently  down, so until the server is up i wont belive it...)

But what i dont get is from where does it get the info about the old rendered files ?

....

Vi 24 sep 2010 00:14:29 +0300 |  | file projects/www.renderfarm.fi/file155162 not found
Vi 24 sep 2010 00:14:29 +0300 |  | file projects/www.renderfarm.fi/file156057 not found
Vi 24 sep 2010 00:14:29 +0300 |  | file projects/www.renderfarm.fi/file156054 not found
Vi 24 sep 2010 00:14:29 +0300 |  | file projects/www.renderfarm.fi/file168057 not found
Vi 24 sep 2010 00:14:29 +0300 |  | file projects/www.renderfarm.fi/file167995 not found

.....

Vi 24 sep 2010 00:14:37 +0300 | Open Rendering Environment | Started download of file155162
Vi 24 sep 2010 00:14:37 +0300 | Open Rendering Environment | Started download of file156057
Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | Incomplete read of 621.000000 < 5KB for file155162 - truncating
Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | Incomplete read of 621.000000 < 5KB for file156057 - truncating
Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | Finished download of file155162
Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | Finished download of file156057

.....

Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | [error] File file155162 has wrong size: expected 4371244, got 0
Vi 24 sep 2010 00:14:41 +0300 | Open Rendering Environment | [error] Checksum or signature error for file155162

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.