Click here to Skip to main content
15,118,077 members
Home / Discussions / C#
   

C#

 
GeneralRe: Need a suggestion Pin
OriginalGriff14-Jul-21 20:03
mveOriginalGriff14-Jul-21 20:03 
GeneralRe: Need a suggestion Pin
simpledeveloper15-Jul-21 23:03
Membersimpledeveloper15-Jul-21 23:03 
GeneralRe: Need a suggestion Pin
Richard Deeming15-Jul-21 23:38
mveRichard Deeming15-Jul-21 23:38 
AnswerRe: Need a suggestion Pin
Gerry Schmitz14-Jul-21 20:11
mveGerry Schmitz14-Jul-21 20:11 
AnswerRe: Need a suggestion Pin
Eddy Vluggen15-Jul-21 10:20
professionalEddy Vluggen15-Jul-21 10:20 
AnswerRe: Need a suggestion Pin
Mycroft Holmes15-Jul-21 13:37
professionalMycroft Holmes15-Jul-21 13:37 
GeneralRe: Need a suggestion Pin
simpledeveloper15-Jul-21 22:55
Membersimpledeveloper15-Jul-21 22:55 
AnswerRe: Need a suggestion Pin
jschell17-Jul-21 11:26
Memberjschell17-Jul-21 11:26 
simpledeveloper wrote:
Hi I have a table which has 100s of 1000s of records

simpledeveloper wrote:
huge json string.


Excel limits.

32k maximum size for a cell
1,048,576 maximum rows
16,384 columns

Excel specifications and limits - Excel[^]

If you already have a 200,000 rows then a reasonable growth estimate would mean your solution would need to support 2,000,000 rows. And that is not going happen in excel.

You didn't define 'huge' nor what is in that json has but see the cell size limit and column limit. Again if you are already pushing those then growth would suggest you will exceed it.


simpledeveloper wrote:
So he wanted me to write a Service to convert that Json string into Excel document,


Is this a one time job? On demand? Once a day? Once a minute? That will impact what is reasonable in terms of how long you your job can take processing this.


simpledeveloper wrote:
convert that Json string into Excel document


Is that the only problem that it is json? Basically the acronym 'ETL' exists for this very thing. So why not do the following
1. Create another database, do not try to do this in the existing one.
2. Create a job that incrementally processes the rows and flattens outs the data into the new database.
3. Then the other person uses that database, with the data nicely parsed out to do what they want.

How to flatten it out? Well if the data is nice and stable then you could just create a table with the columns named appropriately.

If however the json is includes lots of depth and is dynamic then you will need to create a metadata solution such as a table that stores a name, and type, and perhaps another table with values. The types allows you to handle arrays and other embedded types (circular). Keeping in mind that this problem is one you would have needed to deal with an the Excel idea any ways.

This also allows the data to be kept up to date. Then it is up to them, not you, how often to actually pull the data.
Questionc# / wpf/ xaml changing culture (language) at runtime Pin
Maximilien14-Jul-21 3:55
MemberMaximilien14-Jul-21 3:55 
AnswerRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Richard Deeming14-Jul-21 4:01
mveRichard Deeming14-Jul-21 4:01 
GeneralRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Maximilien14-Jul-21 5:38
MemberMaximilien14-Jul-21 5:38 
GeneralRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Richard Deeming14-Jul-21 5:48
mveRichard Deeming14-Jul-21 5:48 
GeneralRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Maximilien14-Jul-21 10:35
MemberMaximilien14-Jul-21 10:35 
GeneralRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Richard Deeming14-Jul-21 22:32
mveRichard Deeming14-Jul-21 22:32 
GeneralRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Maximilien15-Jul-21 2:11
MemberMaximilien15-Jul-21 2:11 
AnswerRe: c# / wpf/ xaml changing culture (language) at runtime Pin
Gerry Schmitz14-Jul-21 6:20
mveGerry Schmitz14-Jul-21 6:20 
QuestionN-Tier best practices when using in MVC application Pin
Member 949196213-Jul-21 14:33
MemberMember 949196213-Jul-21 14:33 
AnswerRe: N-Tier best practices when using in MVC application Pin
Gerry Schmitz14-Jul-21 6:14
mveGerry Schmitz14-Jul-21 6:14 
QuestionExperiencing Memory Leak and unable to Handle it with GC.Collect() Pin
rahulgorai13-Jul-21 8:35
Memberrahulgorai13-Jul-21 8:35 
AnswerRe: Experiencing Memory Leak and unable to Handle it with GC.Collect() Pin
Dave Kreskowiak13-Jul-21 10:41
mveDave Kreskowiak13-Jul-21 10:41 
GeneralRe: Experiencing Memory Leak and unable to Handle it with GC.Collect() Pin
rahulgorai14-Jul-21 3:03
Memberrahulgorai14-Jul-21 3:03 
GeneralRe: Experiencing Memory Leak and unable to Handle it with GC.Collect() Pin
Dave Kreskowiak14-Jul-21 5:16
mveDave Kreskowiak14-Jul-21 5:16 
GeneralRe: Experiencing Memory Leak and unable to Handle it with GC.Collect() Pin
jschell17-Jul-21 11:37
Memberjschell17-Jul-21 11:37 
Question.Tag File Pin
f6112-Jul-21 20:44
Memberf6112-Jul-21 20:44 
AnswerRe: .Tag File Pin
Victor Nijegorodov12-Jul-21 21:38
MemberVictor Nijegorodov12-Jul-21 21:38 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.