Newsbin 6.91 RC4 - Build 5939

[Quade]

https://s3.dualstack.us-east-1.amazonaw ... 4-5939.exe

Lot of little tweaks people have asked for.

Highlights

- Fix for book groups where someone isn't following the "standard" whether on purpose or not.
- Fix for illegal filenames in some posts.
- Found some odd posts that don't follow the yEnc spec properly and need to be worked around.
- You can disable shell integration for Newsbin crashes in Win11. Apparently a shell modifier to make Win11 look like Win10 doesn't respond like Windows does for shell integration.
- 7z long path support is working.
- 7z password probing for unrar is working but is painfully slow. It's always better to add the password to the download if it's not included automatically in the NZV.
- NZB - some NZB's don't include post count in the subject. Newsbin now uses the actual part records and ignores the subject for post counting.
- Groups with "-" in the name were getting imported into the wrong group.
- Header Filtering on import is much more efficient now. It happens after file combining so it's happing far less often. The cost of file combining is now cheap enough that this is more efficient.

Release notes show a bunch more minor fixes.

[JayPea]

Thanks, Quade!

[mimauk]

Just installed the upgrade but when I try to start the programme I get an error message - cannot find VCOMP140.dll

Using Win10 Pro in Virtualbox on a Linux Mint machine.

[Quade]

Someone mentioned this on IRC just now.

https://www.microsoft.com/en-ca/downloa ... x?id=48145

He said installing this fixed it.

I'll investigate. I ran it on a fresh install of Win10 and it didn't complain.

[mimauk]

Just downloaded 32bit and 64 bit versions of the files from a youtube link and installed them in Windows System and Windows System32 folders and rebooted the machine in Virtual Box and it is working fine now.

I have a vague memory of something like this happening a few years ago.

[Moondawgie]

Watch isn't automatically adding files to the download queue with build 5939, even after resetting Post Storage to use Download Age (7 days) and redownloading message headers. It's now working as before after reinstalling Build 5855.

[Quade]

Thanks. I'll check.

[Quade]

I have a fix for the DLL thing. A newer version of FreeImage was using that DLL.

[mimauk]

Cheers. Thanks Quade.

[Quade]

I have a fix for auto-download from watch lists now too.

[Stan]

I can't tell what I might be doing wrong, but it says downloading headers yet when the group(s) is opened it's empty.

The new files stays at 0 also.

I will keep checking what's going on. Anyone else???

Looked further, and it named the group misc.phone.mobile.android to misc.phone.mobile.android-news-newhosting

So, not sure how to fix that either.

Don't have time today, so back to either 6.82 or 6.90 or nb691RC3-5855 or maybe nb691RC4_TEST-5935

[Moondawgie]

I have a fix for auto-download from watch lists now too.

Thanks. I'm looking forward to the next release.

[Quade]

Stan,

I'm downloading headers from the first group, got 10 million headers. I then "show all" and they show up on the screen. The second group doesn't exist on my server.

On the loaded group, the right most control on the upper part of the post list should show numbers. Mine shows "16000/16000" or so. This represents the total number of files. If you're seeing "0/16000" then you're filtering out the posts from the display. Uncheck the last button on the upper area to disable the filters. See what shows up.

[JayPea]

I can't tell what I might be doing wrong, but it says downloading headers yet when the group(s) is opened it's empty.

The new files stays at 0 also.

I will keep checking what's going on. Anyone else???

Looked further, and it named the group misc.phone.mobile.android to misc.phone.mobile.android-news-newhosting

So, not sure how to fix that either.

Don't have time today, so back to either 6.82 or 6.90 or nb691RC3-5855 or maybe nb691RC4_TEST-5935

Do you have more than one news server? Are you pulling headers from more than one news server?

[Stan]

I do NOT have more than one server. It's nothing with filtering as again 6.82, 6.90 work fine.

When getting all headers, it creates a NEW folder/group name.

Like I stated, I got misc.phone.mobile.android-news-newhosting and misc.phone.mobile.android and misc.phone.mobile.android is the real name.

But all group posts go to misc.phone.mobile.android-news-newhosting and not misc.phone.mobile.android and then NewbinPro no longer shows any posts.

I will see if I take the database from misc.phone.mobile.android-news-newhosting and move it to misc.phone.mobile.android if that temp fixes the issue.

But next time I try to retrieve all headers it will go to misc.phone.mobile.android-news-newhosting, from what I can see.

It did it with all my groups, so I had to start over back to 6.90 and get all headers for all my groups, so now I just try 1 or 2 groups, and they end up getting -news-newhosting added as another group/folder and again Newsbin won't read from those and for some reason the real group name and folder stay, but the database gets removed.

If no one else see's this, I can't imagine what's different with my configuration. As it has not been changed and when going back to 6.90 or even the RCs it's fine with them all.

If/when I get time, I am also considering making a separate data folder that only RC4 -5939 can access and see as well.

It seems it's for some reason taking part of my news server name and then also make new folder with the news server name added as the news server name I called it is news-newhosting.

But again, all other versions had no issues.
Because again it's adding -news-newhosting to the folders and that's seems to where it's storing posts but then RC4 won't read from that and looks at the group folder name without -news-newhosting and those databases are somehow cleared out.

[Stan]

OK, made a new data folder, and it still does it, here is a screenshot.



And Storage.db3 gets put into the one ending with -news-newhosting. NO Storage.db3 and only a Range.db3 in the original group folder name.

I changed log to debug, this is what is shown:


[06/06 18:39:51] DEBUG Motd check
[06/06 18:39:51] HIGH PAR Pausing: Disabled
[06/06 18:39:51] DEBUG Repair Init
[06/06 18:39:51] HIGH Par2Repair - Multi-core 4.0
[06/06 18:39:51] HIGH MessageId Filter: Enabled
[06/06 18:39:51] DEBUG Filter Init
[06/06 18:39:51] DEBUG Workers Init
[06/06 18:39:51] DEBUG Start Connection Workers Init
[06/06 18:39:56] DEBUG Connection Status: news-us.newshosting.com SSL Version: TLSv1.2 TLS-RSA-WITH-AES-128-CBC-SHA
[06/06 18:39:56] HIGH news-newhosting-us None xfeature useragent Newsbin Pro 6.91RC4|290 feature enabled
[06/06 18:40:09] DEBUG NZB File Load Checking
[06/06 18:40:11] DEBUG Periodic Search: Executing!
[06/06 18:40:11] DEBUG Periodic: 12 Watch List Items found
[06/06 18:42:01] DEBUG Connection Status: is.newsbin.com SSL Version: TLSv1.2 TLS-ECDHE-RSA-WITH-AES-128-GCM-SHA256
[06/06 18:42:07] DEBUG Connection Status: news-us.newshosting.com SSL Version: TLSv1.2 TLS-RSA-WITH-AES-128-CBC-SHA
[06/06 18:42:07] DEBUG Stored Range: Min: 0 Max: 0 alt.fan.alyssa-milano news-newhosting-us
[06/06 18:42:07] DEBUG Group Numbers: alt.fan.alyssa-milano Min: 2 Max: 788 news-newhosting-us
[06/06 18:42:07] DEBUG Total XOVER Size:alt.fan.alyssa-milano - 2:788
[06/06 18:42:07] DEBUG Group Numbers: alt.fan.alyssa-milano Reps: 1 news-newhosting-us
[06/06 18:42:07] DEBUG XOVER Numbers: alt.fan.alyssa-milano Min: 2 Max: 788 news-newhosting-us
[06/06 18:42:07] DEBUG news-newhosting-us alt.fan.alyssa-milano XOVER: alt.fan.alyssa-milano 2:788
[06/06 18:42:10] DEBUG NZB File Load Checking
[06/06 18:42:12] DEBUG news-newhosting-us Header Block For: alt.fan.alyssa-milano Finished
[06/06 18:42:16] DEBUG Connection Status: is.newsbin.com SSL Version: TLSv1.2 TLS-ECDHE-RSA-WITH-AES-128-GCM-SHA256
[06/06 18:42:18] DEBUG Header Import: Loading Header block: C:\Newsbin1\Import\alt.fan.alyssa-milano-news-newhosting-us-000000000002-000000000788.txt
[06/06 18:42:18] DEBUG NNTPImportHeadersWorker alt.fan.alyssa-milano-news-newhosting-us-000000000002-000000000788.txt
[06/06 18:42:18] DEBUG Header Import: PurgeDays: 0 PurgeSeconds: 0 - C:\Newsbin1\Import\alt.fan.alyssa-milano-news-newhosting-us-000000000002-000000000788.txt
[06/06 18:42:18] DEBUG NNTPDbProcessingThread - Importing Compacts Work:642 Compact: 642
[06/06 18:42:18] DEBUG Header Import: Post Read: 0 Posts Rejected: 0 File: C:\Newsbin1\Import\alt.fan.alyssa-milano-news-newhosting-us-000000000002-000000000788.txt
[06/06 18:42:30] DEBUG NZB File Load Checking



In the END, I had to name my news servers differently. It was not easy as when I added a new it would not work. But finally after a change made to the nbi file I could get headers. SO don't put - in the names like news-newhosting-us, I went to the name newshostingUS
The weird part is this only started with RC4 - 5939
SO FOR NOW I WILL CONSIDER THIS FIXED ON MY END.

[stavros]

Quade,

I suspect that this is an unintended consequence of the fix for :

- Groups with "-" in the name were getting imported into the wrong group.

I suspect that the group detection / naming / creation logic is not correctly recognising the news server names with a "-" in the name
when processing the Import files that contain new headers, as these have the news server name embedded as part of the file name, separated by a "-".

I am currently running 6.91B5 - build 5672, I have lots of groups that have a "-" embedded in the group name that seem to be functioning OK, and have been for many years.

Stavros

[Quade]

Looked further, and it named the group misc.phone.mobile.android to misc.phone.mobile.android-news-newhosting

I missed this.

Dash is the separator for group and server so, the server name should never have a dash in it.

It's probably something I need to enforce in software. Automatically convert a dash into an under-score for instance. I do agree the change to fix dash in group is likely what uncovered this . The actual probably long standing bug is allowing a dash in the server name.

[Stan]

Looked further, and it named the group misc.phone.mobile.android to misc.phone.mobile.android-news-newhosting

I missed this.

Dash is the separator for group and server so, the server name should never have a dash in it.

It's probably something I need to enforce in software. Automatically convert a dash into an under-score for instance. I do agree the change to fix dash in group is likely what uncovered this . The actual probably long standing bug is allowing a dash in the server name.

It's ok, I figured it out and RC4 - 5995 is going fine now. It took a lot of trial and error, though, to figure it out.
I only now use one server as if that don't have the items, it was taken down on all other servers or never even made it to some servers.
Newshosting does have several servers in case the main is down. It's about 8 total because they have IPV4 and IPV6 servers as well as at least 2 other locations.

Now, hopefully if anyone did use a "-" anywhere in the naming of their news sever, changes it.
I call it newshostingUS as I may add their NL server at some point or even try again their EU server.
Right now I am looking for speed and being in the US, using the US server should get the best speed.

[triskel]

"Reply to group" doesn't work...

[Calahan]

After updating from B8 to RC4, Newsbin doesn't download the complete contents of some nzb files.
Very often I only get nfo and sample file but not the wanted mkv (for example).
When I tried the nzb file(s) again, I also saw the missing file was downloaded, but it wasn't saved. Also no line in the Files Tab.
Manually open the nzb and choosing the (before missing) mkv in the the tab, works. The file is then downloaded and saved.

I was happy to see that RC4 correctly sets the date and time of extracted rar files again.
Went back to B8 and the content of all those problem nzb files was downloaded correctly.

[Quade]

No messages in the logging tab?

If you could send some NZB's to TS at Newbin dot com, I could try them.

How are you feeding the NZB into Newsbin?

[Calahan]

Sometimes I doubleclick on the nzb file and sometimes I use Drag & Drop (several files at once) to feed Newsbin.
Could indeed make a difference. (?) I'm installing RC4 again an try to find some nzb files with problems.
Will set logging to Debug and erase logging and files tabs before testing.
Then I will send some examples to you and will post an update here.

Update:
I'm a bit confused now. It seems it has something to do with this DEBUG: NNTPServer: Post doesn't seem to be the post requested...
But the sample files are downloaded and saved and have this DEBUG too. I just saw they are not in the files tab.

It doesn't seem to make any difference how the nzb was feeded to Newsbin. Doubleclick or Drag & Drop seems to be the same.
Which confuses me even more is, that one nzb was handled fine the first time but all next tries leads to missing (big) mkv.
Will now send some example nzb's.

Update 2:
Just tried RC3 and I'm getting the same log info (Post doesn't seem to be the post requested) but all files were saved correctly.
What I don't understand is, that all files are not packed. But the small nfo and sample files are copied to the unrar path but the big mkv is left in the download path.

[Quade]

I'm a bit confused now. It seems it has something to do with this DEBUG: NNTPServer: Post doesn't seem to be the post requested...
But the sample files are downloaded and saved and have this DEBUG too. I just saw they are not in the files tab.

This could be a spurious message. Especially with modern NZBs that have a different subject in the NZB than the subject of the file that was posted. Newsbin doesn't act on this error anymore. It was useful in the past but usenet has changed.

Double-Click and D&D use the same mechanism so it should be the same. I was wondering if you were feeding them to the display list first and then on to the download list. Modern NZB's work best fed directly to the download list.

[Calahan]

Is it by design that auto pause on low space will pause until manually changed?

My downloads go to one drive and are then unpacked to another.
Normally downloads are faster than unpacking, so auto pause stops the download queue.
After unpacking, the downloaded files are deleted so there is enough free space again.
But the pause will stop all further downloads until I see that pause was activated.

Would it be possible that downloads continue if there is enough free space again?

[jcthorne]

i just upgraded from 6.91 B2 and am seeing a lot of instability. Newsbin crashing and closing in less than a half hour at a time. Does not seem to be related to a single NZB either as restarting will bring back up the Download list and then complete the NZB it was previously working on. But then crash a while later. Suggested troubleshooting steps or further information I can provide?

For reference, running under Windows 11.

UPDATE, after a full day of not running longer than minutes at a time, I reverted back to 6.91B2 and its running stable again. For my system, there is something very wrong with RC4. No error messages in the logs that landed any info. It does appear to be related to certain NZBs as if I delete the one highest in the download list and try again it will run a bit longer and find another that crashes NBP.

[Quade]

I found an NZB bug. Not one that would cause crashes though. Newsbin detects duplicate files in an NZB. Because some badly formatted NZB's might have the same file in them multiple times. When the duplicate detector fired, it wasn't cleaning up enough so, it would impact the next non-duplicate file.

The fix for this and for posting will be in the next RC. I'm not seeing any crashing. If you have specific NZBs that can crash Newsbin, I'd love to see some.

[Calahan]

Any info about a possible auto continue after an auto pause because of low space?

[jcthorne]

I found an NZB bug. Not one that would cause crashes though. Newsbin detects duplicate files in an NZB. Because some badly formatted NZB's might have the same file in them multiple times. When the duplicate detector fired, it wasn't cleaning up enough so, it would impact the next non-duplicate file.

The fix for this and for posting will be in the next RC. I'm not seeing any crashing. If you have specific NZBs that can crash Newsbin, I'd love to see some.

All NZBs are sent via Sonarr or Radarr. How can I export an NZB file from Newsbin to send to you? Should not take me long to find the next one that crashes Newsbin RC4 repeatedly.