The End: NZBMatrix closes

by Savid • 14 years ago

165 127 14 years ago

jondiggsit• 14 years ago

This is a sad day.

emehrkay5• 14 years ago

I really feel some type of way about this. This site (and netflix and hulu) allowed me to live without tv for almost four years

skippy2• 14 years ago

The masses need to pick a new site to invest their energies in, rather than scatter at random to lots of different sites! Any particular one out there that's better than the rest?

troels• 14 years ago

As someone who hasn't used usenet for downloading content, why is it that it seems that a few central indexing services are the way people access this medium? Wouldn't it be possible - and preferable - to distribute the index through p2p? That way, there would be no single point of failure.

nwh5• 14 years ago

The index would be insanely huge. A lot of these indexing sites are used for their API. Dedicated applications like SickBeard automatically compile lists of wanted files (movies, TV rips and music) and use them to search against the provider. The provider returns a file (NZB) that contains references to hundreds of encoded files hosted on newsgroups.

Here's a breakdown of one NZB, for a single 3.88GB file.

Inside are 74 RAR files, and 15 additional PAR files containing parity for recovering corrupted data.

Each of these 89 files is split into 37 parts of 1.4MB for ~3200 pieces total.

These pieces are then encoded with yENC (similar to base64) and then uploaded to the newsgroup.

Every single one of these yENC pieces is referenced in the NZB file, making for a total of 400KB. Just because of this, the NZB indexs are enormous; hundreds of gigabytes, probably terabytes in some cases.

Wicher• 14 years ago

Such a project exists: Spotnet

http://en.wikipedia.org/wiki/Spotnet

The searchable information (and comments and such) is distributed through Usenet itself.

slaxo• 14 years ago

I'd give nzb.su a try. I started using them a few weeks ago as an auxiliary when I was having issues with nzbmatrix.

In my short few weeks of using it, the API seems better than nzbmatrix, but the community / comments on files is near nonexistent. If you're only looking for something to hook up to sickbeard / couchpotato though, it should do the job just fine.

Down_n_Out• 14 years ago

Can't sign up for nzb.su at the moment so it seems, together with a lot of others out there ... Nice, but not really.

thehodge• 14 years ago

I had noticed almost everything had been failing over the past few weeks with NZBMatrix...

Back to torrents / DC++

shelf4• 14 years ago

I haven't experienced any missing binaries or bad NZBs recently, neither from NZBMatrix nor Astraweb. Can anyone corroborate this?

cookiecaper8• 14 years ago

I was getting a good amount of missing blocks on Astraweb only; I bought a backup news account from blocknews and haven't had any missing block issues since.

It helps if people put big pars out.

tatsuke95• 14 years ago

I've been using Usenet and Newzbin/NZBmatrix for 4 or 5 years. New content has been getting taken down the past few months. Go look at the comment section of any new movie. It got progressively worse, to the point that I was starting to consider what to do next. I suppose I'm not surprised to see this this morning. But it was abrupt.

tharshan09• 14 years ago

what is DC++ ?

archivator• 14 years ago

A centralized, IRC-like network for file exchange. Or rather, DC++ is the client to that network.

pyre4• 14 years ago

An example of someone writing a better implementation of a program and taking over a protocol. DirectConnect was a centralized client-server file sharing program[1], with a client and server (both written in VB). DC++ was a C++ implementation that started out as 3rd party implementation of the client, and then IIRC the server. The original client/server were incredibly buggy, so DC++ client/server over-took the original client (they may have even extended the protocol).

[1]: Basically, you connect to a central server (that anyone can run), and you can share files with other connected to the server, chat with them (a single central chat room), private message connected users, and search files shared by connected users. Note: that some of this may be out of date as I'm mostly referring to the initial implementation.

pavel_lishin• 14 years ago

> DC++

Wow, a blast from the past - AND a comment asking what it is.

Is it weird to feel old at 29?

spdy• 14 years ago

Coupled with this is problems with payment providers, we have been through pretty much everyone out there, in the end they all pull out.

Here lies the real problem

StavrosK7• 14 years ago

These guys could benefit from BitCoin, if it were ubiquitous. Too bad...

skippy2• 14 years ago

The page up at Newzbin2.es (or at least the Google cached version for those of us in the UK) which shut recently mention that BitCoin is too complicated for most people. I never used it so can't say...

cookiecaper8• 14 years ago

They did utilize bitcoin. I purchased my VIP account with them via bitcoin.

w1ntermute• 14 years ago

Yeah, it would be really exciting to see a resurgence in this area spurred by Bitcoin. It may still happen.

reservate• 14 years ago

Is there a bitcoin only indexer out there?

StavrosK7• 14 years ago

Can anyone explain what this was, for us who didn't know it?

omfg• 14 years ago

An index of movies, shows, apps, etc.. for download from Usenet servers. Similar to The Pirate Bay.

tallanvor• 14 years ago

Think of it like Pirate Bay, but for newsgroups. Newsgroups are massive with some providers archiving binary groups for up to 4 years (and growing). Sites like NZBMatrix index the content and provide nzb files which tell your client what to download so that you don't have to constantly download the headers for a bunch of sites and search through them. Sites like NZBMatrix were also somewhat curated to help keep passworded files out of the results.

tibbon• 14 years ago

And combined with a private usenet server, it was non-P2P and relatively secure file downloading at exceedingly high speeds.

Roelven• 14 years ago

+ the great thing about nzbmatrix was to use their API for the searches. You could then have a local process download the actual files after doing a request to nzbmatrix.

MozMorris• 14 years ago

MacGuffin!! Noooooooooooooooooooooo!!!!!!1

harrod• 14 years ago

Yup. Mr. "a:10 v:10"

emehrkay5• 14 years ago

Those were the most helpful comments. You'd see a four on either metric and know not to waste time.

alternize• 14 years ago

running your own custom tailored usenet indexer seems pretty easy nowadays thanks to http://www.newznab.com/ - if you have a need for one in the first place, that is.

aes2564• 14 years ago

Never understood the appeal of NZBMatrix. Just use a search engine like Binsearch, NZBIndex.nl, etc.

In any case, with more and more takedown requests being directed at usenet providers, I think usenet's days as a safe haven for piracy are numbered.

cookiecaper8• 14 years ago

Binsearch is much harder to navigate.

hackerboos2• 14 years ago

Coupled with http://abteevee.allfilled.com and http://abmoovee.allfilled.com it's easy.

kinnison2• 14 years ago

I don't think usenet itself will be taken down - it actually pre-dates the world wide web - but the battle lines are now drawn.

josteink• 14 years ago

Automation is allot easier on a pre-indexed, pre-QAd, pre-tagged and pre-filtered data than it is on the raw underlying data itself.

Almost all the automation tools spoke newzbin and nzbmatrix.

tvdw• 14 years ago

This is awkward... When newzbin shut down, I was without a NZB provider for a week. Then 2 days ago I paid for my membership at NZBMatrix. And now it's gone?

gadders• 14 years ago

Me too. Bastards. I'll have to raise a chargeback or something.

kinnison2• 14 years ago

Similar position.. but I was waiting a week or two before committing to actual money :) Glad I did. Going a bit old school at the mo, downloading headers from a.b.mm for example. Get some retention up myself, might take a while!

shelf4• 14 years ago

Despite being 99% illicit content, could somebody explain why this is not a case for Safe Harbour? Is this principle enshrined in any law at all, or is it just some neutrality idyll that we assume others share?

*Thought it was part of the DMCA

aes2564• 14 years ago

Their safe harbor protection is not in question at the moment.

They have allegedly shut the site down because they lack the resources to handle the growing tide of takedown requests.

ubernostrum2• 14 years ago

The "safe harbor" includes more requirements than responding to take-down requests. In particular, the service provider must "not have actual knowledge that the material or an activity using the material on the system or network is infringing", and "in the absence of such actual knowledge, is not aware of facts or circumstances from which infringing activity is apparent".

In other words, though you don't have an active duty to police your site, if you do become aware, and don't take action, you're not protected. Similarly, if you set up something with the sole purpose of distributing copyrighted material, and try to hide behind a "gosh, we never knew that kind of thing was going on until you told us", you're probably not going to get a court to believe you.

shelf4• 14 years ago

I was commenting on this sentence, in particular:

>Once this notice is completed we are left with an impossible task of policing our indexing bots. Even then it won't stop there, there will be follow-up notices etc.

This seems to me like they're being told to actively police automatically-indexed content after this notice is processed?

I'm not sure how provable that 'knowledge of infringement' clause is.

upper2bits• 14 years ago

I've never used torrents and I've always used newsgroups. Does that make me old? Anyway, I feel naked now, with newzbin down and now this I feel I'm going to have to end my fun or try torrents which I'm worried about the legal issues. Are torrents "safe" now a days, what's the best approach (Seedbox?)

cookiecaper8• 14 years ago

Torrents aren't really safe or unsafe, it's mostly about the quality of the trackers you use. There are some OK cultivated communities out there, but the worry over ratio and constant leech on one's upload stream is a real bummer when you can just purchasing blocks from a news server and not have to worry about it. A seedbox is way more expensive than a news account and usually comes with quotas which one must mind.

All in all, nzbs are a much more pleasant experience if you can afford the account (and pretty much any employed person can) and have a good indexing site (harder to come by, and now I don't have one either :( ).

jonny_eh• 14 years ago

Wouldn't connecting via a VPN sufficiently hide your tracks from the secret squirrels?

zenocon3• 14 years ago

I'm old too (using USENET since mid-90s). There are other indexers out there. Try http://www.nzbsearch.net/, http://binsearch.info - and if that one goes belly up, there will be others, or install your own private indexer (or write your own). I stay the hell away from torrents.

cookiecaper8• 14 years ago

Would be nice if they would a) publish their code and b) upload their nzb database on Pirate Bay. Would make it much easier for someone to pick up the torch.

dsl2• 14 years ago

NZBs die pretty quickly, so a back catalog wouldn't be that useful. They even mention on the website that content is getting taken down faster than NZBs can be updated.

cookiecaper8• 14 years ago

I've used NZBs that were 3+ years old and they've mostly worked fine. Occasionally blocks are missing, which of course is more likely the older an NZB gets, but most of the catalog is still together.

They're right that many providers are getting hit with notices, which causes them to remove a few chunks of each rar from their server making it impossible to complete the download and too pervasive for repair by typically-sized parity file, but this can be circumvented by using a lesser-known news server as a backup; you still use Astraweb or Giganews for 99% of the transfer, but your fallback picks up the pieces that have been DMCA'd out of AW/GN/another major carrier.

I would be happy to see a more intelligent splitting system than rars, as one missing block in a couple of rars will often make it really difficult to extract the content you DO have and use a more robust delivery system, like a torrent, to download the blocks you're missing. This is going to become increasingly important.

News servers are interesting because they really are a non-optimal method for this kind of transfer that has incidentally become a hot bed for filesharers, probably just because of the plausible deniability ("yes officer, of course we only intend our server to be used by those discussing photography..."). I too wonder if it's not time for a new protocol, something more direct than torrents (webseeds kinda works here, but not quite what I'm looking for) but less hacked-up than NZBs and ASCII-encoded binaries in split files.

It's time to stop skirting around the issue and try to put together a serious underground analog to direct-downloaded binaries, something hearty and immune, or as immune as possible, to interference and foul play like this.

daniel777• 14 years ago

you can bet your bottom this fact''Federation Against Copyright Theft Limited''will be into all nzb providers now by attacking the index list making sites like nzb matrix take down massive amounts of copyrighted movies and other copyrighted items, changes in the usenet indexing this looks bad all round for us downloading they cant get the server providers so they will go after the next best thing the index system that list content.

omarchowdhury• 14 years ago

And why aren't they able to get the server providers?

Rhythmic2• 14 years ago

It was probably cheaper to force or induce the closure of index sites that are done more as a love of community than of profits, not make nearly as much as the usenet providers themselves. These index sites, I'm sure, understand the legal costs and risks of continued operation if those options were presented to them. With the majority of them down and out of the way the providers themselves will see a reduction in revenues and may not put up a fight when they fall into legal pressure to close up shop.

portsmouth657• 14 years ago

a lot of chat about "we never use them and get by" ,,how about some feedback for alternatives!!!!! i have only ever used newzbin ,,then yesterday paid matix ,and today not sure where to go?

ComputerGuru2• 14 years ago

The second Newzbin also closed this week: http://www.newzbin2.es/

Apparently their last payment gateway wouldn't deal with them any more.

zenocon3• 14 years ago

alternative: http://www.nzbsearch.net/

mimog• 14 years ago

That's not really an alternative..

zenocon3• 14 years ago

why not? admittedly, i didn't use nzbmatrix, but i do use nzbsearch and the ui is simple, easy to use - search is ok, but it seems to get the job done.

edwardh• 14 years ago

Gotta say that I find it very questionable how many people dump on nzbmatrix or say that it was not necessary anyway.

Sure, if you only watch high quality stuff like Skyfall and listen to Lady Gaga, a site like nzbmatrix is probably useless to you. But for those who appreciate things that aren't that easy to come by, it is essential to have some sort of an index to even HEAR about them. My estimate is that at least half of the movies and games I got through nzbmatrix, I had not heard about anywhere else. And as every usenet user knows, it's basically just not possible to "browse" the usenet itself.

Then there are software releases where 95% are fake or bug-ridden. Where it saves a LOT of trial & error if people help each other out by posting only those that are for real.

And I found no other nzb site as useful when it comes to finding all new releases. And I have looked at them all because I did not appreciate nzbmatrix's own censorship.

res0nat0r• 14 years ago

You don't need a usenet indexing site to learn about good indie movies or music. There are dozens of websites that review and discuss these things without releasing them for free against the authors wishes....

prezjordan• 14 years ago

Binsearch [0] usually does the trick for me. Admittedly I'm not a hardcore user.

[0] http://binsearch.info

tptacek3• 14 years ago

This is a Usenet binary sharing site whose front page, in a Usenet "video review", was a table of movies, TV shows, and video games. In other words, it wasn't even possible for the owners to look at their own site and not know that it was being used almost exclusively as a tool for piracy.

Extremely common DMCA misconception: it's not enough to be "takedown compliant". That's not how the law works. You also can't ever operate with specific knowledge of infringing content; you are, in effect, required to "take down" any pirated content you find.

cdh• 14 years ago

Has it actually been established that merely linking to copyrighted content is illegal in the United States? I'm not trying to troll, just genuinely curious.

My technical understanding of this could be incorrect, but it seems to me that there is a meaningful difference between a BitTorrent tracker actively coordinating copyright infringing downloads vs. a website like NZBMatrix hosting nothing but static links to another location on the Internet.

tptacek3• 14 years ago

The NET act criminalizes any willful "copyright infringement" (the term used in the act) so long as it's done for financial gain. Contributory or vicarious liability for copyright infringement for linking is well established.

At any rate, services like these rely on the DMCA Safe Harbor provision. Regardless of whether the potential liability is civil or criminal, you can't have actual knowledge of infringing activity on your site and the ability to remove that activity from your site and claim safe harbor.

emehrkay5• 14 years ago

Open source the code. Id gladly run my own private nzbmatrix

spudlyo2• 14 years ago

Feel free.

http://newznab.readthedocs.org/en/latest/

emehrkay5• 14 years ago

You've derailed my Sunday. Thanks. Is this the nzbmatrix core?

emehrkay5• 14 years ago

I got this running btw. Thanks again.

Just a heads up for whoever wants to do the same: the process that it goes through to create the releases is that it downloads all of the binaries and parts and then runs that through a few regular expressions to determine what goes with what and how it should be categorized and displayed. The free community edition only ships with two regular expressions and it wasnt creating releases for me. I donated to the project and got a lot of regexes plus some other stuff and now it works as expected.

I'll be building a box to handle this in my home.

thechut• 14 years ago

This is a major blow to usenet. But more importantly this could be the start fo something very very bad for usenet. It, and it's users of who I am sure there are plenty on HN, have so far been able to fly under the anti-piracy radar of the big media companies. This clearly demonstrates that they know exactly what is going on, and may be on the war path to shut down more indexes and search engines.

tptacek3• 14 years ago

Nauseating. Piracy killed the real Usenet, and now pirates are upset that enforcement is killing the goofy little playground they built inside its corpse.

When I was 18, I ran a competitive (on the Freenix leaderboard) full-feed Usenet server for the ISP I worked at. Every ISP in the world could have provided full-feed Usenet access, but for the assholes who loaded the system down with ASCII-encoded binaries. Even while it was possible for an independent provider to offer Usenet to customers, it was still a total nightmare because of the ludicrous storage requirements for binaries, which ensured that only an ever-dwindling number of providers would take the time to offer it at all.

It's startling to me that there's a Usenet at all anymore, since it's essentially been reduced to a collaborative system for sharing pirated binaries.

ChuckMcM• 14 years ago

I like the imagery.

So I am chuckling at the idea that some young guns who want to be "free" to do what ever they want in their network of computers to come up with a scheme where they are will use telephones to call up one computer to the next, and addressing will be free form a series of "hops" where you tell the computer what sequence of machines will have to be called in order to get your message from you to your destination. You could use a character like ! to separate the hops making an address 'bobs-machine!piratebay!alices-machine!alice' delivering through three hops to Alice.

NateLawson2• 14 years ago

I was also running a news server for my school and an ISP around the same time (1994-1996). The alt.binaries hierarchy was a constant headache. The total data flow and storage requirements were already about 10X the rest of Usenet. We had to manually tweak refuse lists when the disk drives filled up.

I wasn't still around, but I expect the second wave of automated binary posting/retrieval tools in the late 90's probably created the surge that changed Usenet access into a separate paid service, no longer something that came with an ISP account like email.

However, it wasn't just warez and porn that killed Usenet. Spam took off there before email, and it wasn't until email spam became untenable that modern automated filtering tools were created.

chiefsucker• 14 years ago

That’s just one side of the coin, though. While the binary tree played a role in the ”death” of the Usenet, services like AOL played another major role. Companies tried to make the internet more comprehensible for the average user and invented forms of communication that they thought of would be understandable by the masses and easier to sell (remember those pesky ”You’ve mail” AOL ads?).

Furthermore I don’t think it’s true that the Usenet is dead. There are still some active groups that rely on it. It’s just that there’s so much more these days. There are several social services competing with each other, there are a lot of web sites that let you discuss about things and are targeting specific niches.

Usenet wasn’t killed, it’s natural progress.

nicksterling3• 14 years ago

Question for those with Usenet know how. When downloading raw headers, I have observed a convention where the title is a random string of letters and numbers, and within the post are for example 50 rars and 10 pars. How are consumers 'decoding' the title so they know what they are getting? Does the uploader provide a translation? Or can the 'real title' be recovered programmatically? Many thanks.

voltagex_3• 14 years ago

Can you give an example?

nicksterling3• 14 years ago

Here's one from a.b.boneless...

"2TU4K75C6Z" (45 rars, 9 pars)

And here's one from a.b.multimedia...

"DTTBiAp23.101.by.NYCrules" (14 rars, 11 pars)

no .nfo included and no way to know what's inside. Does anybody know how people are decoding these titles into meaningful information?

xer0x2• 14 years ago

Such disappointing news compounds last weeks troubles. When nzbs'r'us shutdown over similar payment problems. Payment is a huge achilles heel for these services. Blocking payments was used to hurt WikiLeaks, and Dutch usenet providers have recently lost the ability to use paypal for payments too. A popular bitcoin-esque service can't happen soon enough.

http://usenetreviewz.com/dutch-usenet-providers-banned-by-pa...

xer0x2• 14 years ago

I like that Europe scolded visa for stopping payments to wikileaks, but that is unlikely to ever happen for anything piracy related.

http://falkvinge.net/2012/11/20/europarliament-scolds-visa-m...

greencopper• 14 years ago

There is NO such thing as priracy, there is only sharing of property between people. When I buy something I own it, no matter what those fools say, and when I own it, I copy it if I like!

Rhythmic2• 14 years ago

And thus we explore a brief glimpse of the tragedy of the commons.

cmccabe• 14 years ago

Welcome to the NZBMatrix.

I don't care who you are, if you see an agent, you do what the rest of us do. You run. You run your ass off.

whiteymj• 14 years ago

Move the site to TOR and let digital copyright enforcement cops try to figure that one out. All they can do it push it completely underground and once the site is on TOR they have zero recourse or means to track down the operator.

foobarqux3• 14 years ago

Do not do this. The Tor network cannot handle that kind of traffic.

cookiecaper8• 14 years ago

The site is just text transmission, like torrents. Your connection to the news server would not have to be piped over Tor, just your access to the web interface where you download text files telling your news client what to download.

jrockway• 14 years ago

I guess in this era of Bitcoins and Tor hidden services, it's inevitable that a site using credit card funding and a public IP address for piracy is being shut down. Low-hanging fruit.

rdl• 14 years ago

Is USENET anything other than file sharing (mostly piracy) now?

jockc• 14 years ago

I know that comp.lang.lisp is still active.. I assume there are plenty of other groups still active as well.

TomHere• 14 years ago

A bunch of fucking assholes. They took my money the day before. Wish I could get my hands on them....

tonystamp• 14 years ago

I'm currently using www.nzbzombie.com and its been great , has an API that works with CouchPotato & Sickbeard and phpBB forums.

The End: NZBMatrix closes

Related Stories