Proposal: Big Data

I think Big Data is a too specific domain.

However, there's no place on stackexchange about "data" which would cover:

  • storage : filesystem, media, storage systems (raid, vendors, etc)
  • access: NAS (protocols, network equipements), SAN (switches, fiber, FC, iSCSI, etc)
  • backup (tape, disk to disk)
  • processing, indexing, archiving

Big Data is about storing and processing, so that would fit it in i guess

share

I think it's very telling that we've had several people telling us almost the same thing, and yet each is contradicting the others.

Apparently, all Big Data questions fit best on Server Fault. No, not Server Fault, DBA. No, not DBA, Super User. No, not Super User, Stats. No, not Stats, GIS. No, not GIS, Stack Overflow ... and so on ...

Here's the thing. Those of us working in Big Data, cover a small bit of each of those areas, and some legal stuff, some organisational psychology, some academia, some web apps, some unix, some ubuntu, some UX, some computer science, and doubtless other areas too. Perhaps someone would like to do a quick check on how many of those Stacks have big-data tag, and how many questions there are on each.

But we only use a corner of each of those fields. We have more in common with other Big Data practitioners, than with specialists in each of those fields.

That's why Big Data is worth a site on its own. And why it's different to just "data".

So I'm optimistic that a Big Data site can thrive; it won't detract significantly from existing Stack Exchanges; it will be open to specialists in all those other fields, who will be able to share their expertise across several Stacks, as many of us already do.

share
1  
Was going to post but you hit it out of the park. – Dan Ciborowski - MSFT Apr 4 '13 at 3:09
    
Actually, I wasn't particularly suggesting that BigData should have its own site, but that the other subjects raised in the original post belonged elsewhere. I am happy to delete the last sentence of my answer if others are happy to actually read the rest. – Verbeia Apr 4 '13 at 19:49

I think Big Data is a too specific domain

Thats true but still you cant isolate it from The system where the data reside on, i mean the database management system or the datawarehouse or even simple plain files.

and there is a site now that discusses about Data, big and small, Database management systems and datawarehouses and business intelligence and database administrators Designers and developers all is discussed in http://dba.stackexchange.com/

share

This is the classic set of problems with any inter-disciplinary work. Neuroscience during the nineties, for example. After a while, it becomes clear that while a certain activity -- like big data -- overlaps with parts of many other fields (data management, visualisation, high performance computing, ...) but isn't really a part of any of them. The best response is to put the specialists in one place, instead of trying to fracture them into a set of different fields that all consider the interest a minority topic.

share

Instead of Big Data, we can not have something else,

as this is the evolving and specific term refer link

that is mainly important in the research/scientific/military domains, where they capture big data at a time and process it at the same time(in run time).

We can not compare it will the normal data we process in daily life, as each one is of specific domain and requires processing in the same way, instead of chunks.

I will go with Big Data..

share
    
Nope. Big Data isn't a synonym for Data Warehouse. – user74613 Apr 8 '13 at 11:06
    
Some more educated people than me already explained it: en.wikipedia.org/wiki/Big_data vs en.wikipedia.org/wiki/Data_Warehouse – user74613 Apr 8 '13 at 11:13

I would have thought that much of the subject area mentioned in this question would be on-topic on Server Fault.

Their FAQ states:

If your question is about…

  • Server and Business Workstation operating systems, hardware, software and virtualization
  • Enterprise storage, backup, and disaster recovery
  • Network routing, switches, and firewalls
  • Operations, maintenance, and monitoring

and it is not about…

  • Anything in a home setting
  • Product, service, or learning material recommendations
  • Career, salary, personnel, employment, or formal education
  • Licensing, legal advice, and circumvention of security or policy
  • Unauthorized hacking, password cracking, or system misuse

…then you’re in the right place to ask your question!

This is not a comment on whether specifically Big Data questions also belong on an existing site.

share
4  
In this case, I think it's helpful if downvoters can leave an explanation. Downvotes are different on the Area51 discussion, they just imply disagreement and don't affect rep, so don't be afraid to voice why you disagree, and help convince others to support your proposal. – jmort253 Jun 24 '12 at 18:37
    
Big data is about more than just storing information on servers. There are certainly big data questions that are off topic for Server Fault. – Fomite Apr 4 '13 at 18:38
    
Maybe there are, but if you read my post you will see that it is mainly saying that the topics mentioned in the question, which are data-related but not Big Data topics may belong on Server Fault. The final sentence was a bit of an addendum. – Verbeia Apr 4 '13 at 19:46

All of those things would be acceptable on Super User (I think). The kind of stuff Big Data handles is, well, bigger.

It's like the difference between shooting a bullet and throwing it.

share
2  
Questions about OODT or iRODS would appropriate on Super User? OAIS or TRAC? – Joe Jun 28 '12 at 13:53

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .