How much time should group data import from V5 take?

[UlrichKliegis]

Hi, after updating to V6, I started the import of existing V5 group data, follwing the directions in the readme text. The first day, that went off quite promisingly, but now it seems to handle each and every byte personally with no sense of urgency. The import has been active now since July 13 , having July 17 today. Is this normal? Dual Core AMD Athlon X2, XP pro. The SPOOL_V1 folder has 18.6 GB now, SPOOL_V6 12, growing at a rate of about 100 MB/24hrs.
The activity bar in the import window is growing, sometime very slowly, other times yet slower. No reaction to any clicks (and I did not reset or otherwise kill anything yet). Sometimes. the bar seems to start a new action, growing from left again.

What can I do to find out if this is still reasonable activity or if it has landed in an endless loop?
Retrieving new data via imported nzb files works, though, including AutoRAR

Thanks,

U.

[DThor]

If you have a crapload of spool, it will take a long time. I'm reasonably sure it's not in a loop. Personally I don't bother with this exercise in disk thrashing, I just redownload. I used to caveat that with 'but I don't have half a terabyte of spool either', but I'm not saying that anymore - I really think the payback you get from importing vs just biting the bullet and re-grabbing isn't really worth it. But then, for some it might actually be a cost to redownload, so, the option's there.

Sadly, you're at that stage where you don't know if you'd just left it for another couple hours, it would be done. How big a spool(physically) are we talking? Also, if for some reason you tended to download a lot of spools that have tons of images, spam or viruses, it can be even slower.

DT

[UlrichKliegis]

As mentioned in the original posting, it's 18 GB old, 12.3 GB in the newer SPOOl folder.

Here is a dirprint copy of the newsbindata folder's contents:

Name Größe Geändert am TreeSize
Newsbindaten 16.07.2011 03:41 31486,4 MB
Images 13.07.2011 16:30 0 MB
Read Posts 05.07.2011 10:48 < 0,1 MB
SPOOL_V1 16.07.2011 23:35 18618,3 MB
SPOOL_V6 13.07.2011 20:14 12316,0 MB
Temp 27.05.2011 13:47 0 MB
AutoPAR2.DB3 395.535 KB 16.07.2011 03:40 386,3 MB
AutoRAR.db3 7.864 KB 05.07.2007 23:58 7,7 MB
AutoRAR.txt 90 KB 17.12.2006 11:06 < 0,1 MB
Autosave.nzz.bak 23 KB 03.05.2008 01:25 < 0,1 MB
ChunkToFile.db3 8.247 KB 02.04.2006 22:26 8,1 MB
Downloaded.db3 12.190 KB 13.07.2011 16:30 11,9 MB
DownloadedFiles.txt 3.566 KB 16.07.2011 03:41 3,5 MB
DownloadMarker.db3 68 KB 16.07.2011 03:41 < 0,1 MB
Downloads.db3 560 KB 15.07.2011 23:34 0,5 MB
Downloads.db3-shm 32 KB 13.07.2011 16:30 < 0,1 MB
Downloads.db3-wal 8.040 KB 15.07.2011 23:34 7,9 MB
Failed.nzz.bak 71 KB 16.04.2008 02:23 < 0,1 MB
Filters.db3 12 KB 13.07.2011 16:30 < 0,1 MB
filters.xml 2 KB 09.03.2007 04:08 < 0,1 MB
groups.db3 8.388 KB 17.10.2010 08:27 8,2 MB
GuiItems.db3 9 KB 10.05.2008 18:45 < 0,1 MB
Kopie von newsbin.nbi 40 KB 30.10.2008 21:52 < 0,1 MB
newsbin.nbi 39 KB 25.10.2010 14:51 < 0,1 MB
newsbin.nbi.bak 40 KB 14.10.2009 23:32 < 0,1 MB
NewsBin.nbi.non 1 KB 02.10.2009 22:15 < 0,1 MB
NewsBin.nbi.okt09.neu 3 KB 02.10.2009 18:11 < 0,1 MB
PAR.DB3 37.160 KB 20.06.2006 14:51 36,3 MB
ParSlice.DB3 11.592 KB 22.08.2006 17:49 11,3 MB
PosterLockout.txt 6 KB 22.01.2011 13:49 < 0,1 MB
PosterLockout.txt.bak 6 KB 22.01.2011 13:49 < 0,1 MB
Scratch.nzz.bak 3 KB 02.03.2008 21:10 < 0,1 MB
SearchList.db3 3 KB 17.09.2010 00:50 < 0,1 MB
Settings.db3 15 KB 02.04.2006 22:26 < 0,1 MB
SIGNATURE.db3 71.718 KB 26.12.2010 19:17 70,0 MB
test.txt 1 KB 07.07.2011 18:07 < 0,1 MB

[UlrichKliegis]

Sadly, you're at that stage where you don't know if you'd just left it for another couple hours, it would be done. How big a spool(physically) are we talking? Also, if for some reason you tended to download a lot of spools that have tons of images, spam or viruses, it can be even slower.

Well, this is getting unfruitful. What - except the notion which files I have already and which not - do I have to loose if I just shut it down and restart? Will I have to manually clear any files generated by the import?

For a future version, please let me suggest more transparency and options to take control at this point.

So, will newsbin's just generated new database become seriously incontingent if I kill the import? Or will it repair itself with a new reload of the headers?

Thanks for your comment!

U.

[EDIT:] Some time after writing this, I had to restart the PC anyway. No visible damage so far...

[Moondawgie]

My signature file was about 1.7 GB in size. The conversion took about 62 hours.

While the conversion was in progress I kept wishing that there had been a way to covert the file from it's location on one drive, to another drive, so that reads were from one drive, and the writes to another. Or that the Signature generator utility had been been updated to create/add to a Version 6 signature.db3 file.

[Quade]

My signature file was about 1.7 GB in size. The conversion took about 62 hours.

Conversion doesn't touch the signature file. Maybe you mean something else?

Conversion processes RV4 files into DB3's.

[Moondawgie]

My signature file was about 1.7 GB in size. The conversion took about 62 hours.

Conversion doesn't touch the signature file. Maybe you mean something else?

Conversion processes RV4 files into DB3's.

Duh... I meant the entire conversion process. Sorry about that.

If the signature file isn't touched, does that mean the the signature generator will work with version 6?

[Quade]

You can try. I avoid touching the signature files programming wise. Backup first.

[Alexx]

@Quade: can you tell me what is the problem with signature files?

[itimpi]

@Quade: can you tell me what is the problem with signature files?

What problem with signature files? As far as I know there is not one as v6 uses the same signature file format as v5

[Quade]

Yeah, I'm just suggesting you back up the signature file before messing with it.