Click here to Skip to main content
15,892,005 members
Home / Discussions / Design and Architecture
   

Design and Architecture

 
GeneralRe: application Integration Pin
David Skelly20-Jul-09 22:38
David Skelly20-Jul-09 22:38 
GeneralRe: application Integration Pin
kebedetesema21-Jul-09 21:43
kebedetesema21-Jul-09 21:43 
GeneralRe: application Integration Pin
Robin_Roy21-Jul-09 19:25
Robin_Roy21-Jul-09 19:25 
AnswerRe: application Integration Pin
Rozis20-Jul-09 11:04
Rozis20-Jul-09 11:04 
QuestionLarge number of storage / insertion of records in MySQL Pin
ajitsunny18-Jul-09 3:54
ajitsunny18-Jul-09 3:54 
AnswerRe: Large number of storage / insertion of records in MySQL Pin
Eddy Vluggen18-Jul-09 9:42
professionalEddy Vluggen18-Jul-09 9:42 
AnswerRe: Large number of storage / insertion of records in MySQL Pin
Robin_Roy26-Jul-09 17:50
Robin_Roy26-Jul-09 17:50 
GeneralRe: Large number of storage / insertion of records in MySQL Pin
ajitsunny4-Aug-09 0:00
ajitsunny4-Aug-09 0:00 
I my case we need to optimize two tables to stores very large number of records (in millions / billions) - just change the table structure and apply horizontal partitions on date range or no. of records. The new table structure should be able to minimize the records required to store.

1.
location_BookedAdvertisement (loc_id, advt_id, start_date, end_date, inventory_text)
And data would be like this for location_BookedAdvertisement table:
(12, 132, 2009-07-20, 2009-07-25, '1000~2000~5000~8900~3000')

This structure reduces the number of rows required to store 100,000 location's date wise assigned inventory by 364 times. Now I only need to store 100,000 rows instead of 100,000 x 365. So I am giving this table structure OK DONE. Also partition this table on no. of records such as 10 millions rows per partition.

2.
Now change the structure of tinventory table..
location_ inventory (loc_id, date, Total_available_inventory, booked_inventory)
.. to
location_ inventory (loc_id, year, Jan1, Jan2, Jan3, Jan4 ,.. ..., Dec29, Dec30, Dec31)
And data would be like this for location_ inventory table:
(12, 2009, '5000~2000', '10000~8900',... ...,'12000~2000','12000~2000','12000~2000')

Here within date column we have 'Total_available_inventory~booked_inventory'.

I know there would be 366 column in one table... but today I tested it.... SELECT / INSERT / UPDATE works very very fast as compared to in the earlier table structure. I'll partition this table year-wise i.e based on year column. And this table structure again reduces the required number of records by 364 time... i.e. to store one year inventory of 100,000 locations I would need to store only 100,000 rows.

This solution is acceptable.
QuestionHibernate-style coding? Pin
NandoMan16-Jul-09 21:17
NandoMan16-Jul-09 21:17 
AnswerRe: Hibernate-style coding? Pin
NandoMan16-Jul-09 21:46
NandoMan16-Jul-09 21:46 
AnswerRe: Hibernate-style coding? Pin
Curtis Schlak.17-Jul-09 15:24
Curtis Schlak.17-Jul-09 15:24 
GeneralRe: Hibernate-style coding? Pin
NandoMan19-Jul-09 7:03
NandoMan19-Jul-09 7:03 
GeneralRe: Hibernate-style coding? Pin
Curtis Schlak.21-Jul-09 16:17
Curtis Schlak.21-Jul-09 16:17 
QuestionCreating interface that can read network traffic Pin
that_dude_tj16-Jul-09 13:11
that_dude_tj16-Jul-09 13:11 
AnswerRe: Creating interface that can read network traffic Pin
CodingYoshi16-Jul-09 17:15
CodingYoshi16-Jul-09 17:15 
GeneralRe: Creating interface that can read network traffic Pin
that_dude_tj17-Jul-09 14:48
that_dude_tj17-Jul-09 14:48 
QuestionConsultant/Principal/Senior Software Engineer Pin
leowangrenbenmg15-Jul-09 23:24
leowangrenbenmg15-Jul-09 23:24 
AnswerRe: Consultant/Principal/Senior Software Engineer Pin
Pete O'Hanlon15-Jul-09 23:34
mvePete O'Hanlon15-Jul-09 23:34 
GeneralRe: Consultant/Principal/Senior Software Engineer Pin
Paul Conrad25-Jul-09 19:26
professionalPaul Conrad25-Jul-09 19:26 
GeneralRe: Consultant/Principal/Senior Software Engineer Pin
Pete O'Hanlon29-Jul-09 9:11
mvePete O'Hanlon29-Jul-09 9:11 
GeneralRe: Consultant/Principal/Senior Software Engineer Pin
Paul Conrad29-Jul-09 12:39
professionalPaul Conrad29-Jul-09 12:39 
AnswerRe: Consultant/Principal/Senior Software Engineer Pin
Eddy Vluggen16-Jul-09 2:27
professionalEddy Vluggen16-Jul-09 2:27 
QuestionIs this an existing pattern Pin
sadavoya15-Jul-09 7:30
sadavoya15-Jul-09 7:30 
AnswerRe: Is this an existing pattern Pin
CodingYoshi15-Jul-09 17:27
CodingYoshi15-Jul-09 17:27 
GeneralRe: Is this an existing pattern Pin
sadavoya17-Jul-09 5:31
sadavoya17-Jul-09 5:31 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.