Header downloads

There is no such thing as a stupid question here as long as it pertains to using NewsBin. Newbies feel free to get help getting started or asking questions that may be obvious. Regular users are asked to be gentle. :-)

Moderators: Quade, dexter

Header downloads

Postby rbro3 » Sat Nov 10, 2018 5:39 pm

Hello: 3 :idea: things:

1. I subscribed to a.b.mom group with has 2 billion headers. Everytime I crank up newsbin it starts downloading millions of headers. When I remove the file from the download list newsbin stops downloading the headers. Next time I start newsbin it starts downloading headers again. I already got a couple of million headers from a.b.mom and I don't want 2 billion headers, I imagine it would take up huge file space. How do I stop newsbin from downloading 2 billion headers? How do I download say, only 500,000. and then any new ones that come after that?

2. Is there a tutorial or post somewhere that describes how header downloads work? I see lots of options under the download menu but I don't understand how they work.

3. Same goes for the "Post" menu. Where's the instructions please?
rbro3
n00b
n00b
 
Posts: 1
Joined: Sat Nov 10, 2018 4:46 pm

Registered Newsbin User since: 10/18/09

Re: Header downloads

Postby Quade » Sun Nov 11, 2018 11:48 am

1 - Set the "Download age" to say, 10 in the options.

2 - Delete the entry in the download list for "mom" let things settle a bit then right click the group "Post Storage/ Use Download Age" to reset how far back in time Newsbin will download headers. Because of #1 it'll just do 10 days next time.

3 - If it still downloaded more than 110 million or so posts. I might delete it again, then delete the import folder (as I describe below) and reset the age again.

4- It sounds like you have Newsbin set in the options to update headers every time it starts. You might want to disable that option. If it's not set, let me know.


Headers are a constant treadmill. New headers are added to the end, while old headers are removed from the beginning. So, if you want to download headers, you need to do it frequently to keep up with the new headers that are posted. 10 days of a.b.mom seems to be about 115 million headers. Headers are downloaded, saved on disk, then processed into the database. If you look down where it says "Cache X/Y (XX)" the numbers inside the "()" is the number of headers files in disk that are waiting to be processed. If it's a large number, you might want to delete them all before you download new headers.

In the options "Open Data Folder" then delete the "Import" Folder before you do the "Download Age" thing I mention above.

There's really not many options for headers.

1 - How long you keep them (storage age).
2 - How many you download the first time you use a group (download age)
3 - Whether you download them when Newsbin starts.
4 - Whether you have Newsbin update them periodically when Newsbin starts.

Keep in mind that some groups these days, it's pointless to download headers from. I don't know if "mom" is that way but I'm looking. Some groups have been taken over by obscured postings and only our search engine or an NZB site can give you information on how to download from that group. Just a quick glance suggests "a.b.mom" is mostly encrypted these days.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 43281
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to Newbie Forum

Who is online

Users browsing this forum: No registered users and 1 guest