Geekzone: technology news, blogs, forums
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.

3445 posts

Uber Geek
+1 received by user: 441


Topic # 95453 4-Jan-2012 23:11
Send private message

Hey guys,

Firstly this is a copy and paste from gpforums so sorry anyone who checks both.

I'm just trying to decide on the best way to support a "database within database" concept. Basically the situation is we have a web application where users can upload big as spreadsheets. They can use a form to enter some data and an AJAX runs using one of the columns from their spreadsheet to match and if it matches, populate some other fields with the associated row data.

In terms of numbers we are expecting spreadsheets of up to 20 columns and maybe 30,000 rows. We could have a few hundred of them.

Our (ex) developer performed some "tests" and decided EAV would be best. Well his test must have been 3 columns and 10 rows as EAV seems to such with these volumes no matter what we do with indexes. Like almost 5 minutes to load a spreadsheet some times which obviusly won't work for AJAX. The ideas we have come up with:

- Find a magical solution to make EAV work
- Have one table per spreadsheet (leaning towards this atm)
- Look at no-sql DB (scary)
- Maybe store the databases as files on the filesystem and use PHP to parse and "query" them (probably bad idea)

What are people's thoughts on this? We are using MySQL 5 for the DB server but could implement something else.

Create new topic
8029 posts

Uber Geek
+1 received by user: 387


  Reply # 564814 5-Jan-2012 14:30
Send private message

Replied on gp since I saw it their first

Create new topic

Donate via Givealittle

Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:

Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:

Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:

News »

Amazon introduces new Kindle with adjustable front light
Posted 21-Mar-2019 20:14

A call from the companies providing internet access for the great majority of New Zealanders, to the companies with the greatest influence over social media content
Posted 19-Mar-2019 15:21

Two e-scooter companies selected for Wellington trial
Posted 15-Mar-2019 17:33

GeForce GTX 1660 available now
Posted 15-Mar-2019 08:47

Artificial Intelligence to double the rate of innovation in New Zealand by 2021
Posted 13-Mar-2019 14:47

LG demonstrates smart home concepts at LG InnoFest
Posted 13-Mar-2019 14:45

New Zealanders buying more expensive smartphones
Posted 11-Mar-2019 09:52

2degrees Offers Amazon Prime Video to Broadband Customers
Posted 8-Mar-2019 14:10

D-Link ANZ launches D-Fend AC2600 Wi-Fi Router Protected by McAfee
Posted 7-Mar-2019 11:09

Slingshot commissions celebrities to design new modems
Posted 5-Mar-2019 08:58

Symantec Annual Threat Report reveals more ambitious, destructive and stealthy attacks
Posted 28-Feb-2019 10:14

FUJIFILM launches high performing X-T30
Posted 28-Feb-2019 09:40

Netflix is killing content piracy says research
Posted 28-Feb-2019 09:33

Trend Micro finds shifting threats require kiwis to rethink security priorities
Posted 28-Feb-2019 09:27

Mainfreight uses Spark IoT Asset Tracking service
Posted 28-Feb-2019 09:25

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.