Click here to Skip to main content
15,899,025 members
Home / Discussions / Database
   

Database

 
QuestionAdvice on Perfomance Turning of the Query Pin
Vimalsoft(Pty) Ltd28-Oct-14 7:27
professionalVimalsoft(Pty) Ltd28-Oct-14 7:27 
GeneralRe: Advice on Perfomance Turning of the Query Pin
PIEBALDconsult28-Oct-14 8:04
mvePIEBALDconsult28-Oct-14 8:04 
AnswerRe: Advice on Perfomance Turning of the Query Pin
Eddy Vluggen28-Oct-14 8:59
professionalEddy Vluggen28-Oct-14 8:59 
AnswerRe: Advice on Perfomance Turning of the Query Pin
Mycroft Holmes28-Oct-14 12:59
professionalMycroft Holmes28-Oct-14 12:59 
GeneralRe: Advice on Perfomance Turning of the Query Pin
Vimalsoft(Pty) Ltd4-Nov-14 21:56
professionalVimalsoft(Pty) Ltd4-Nov-14 21:56 
QuestionCombine results from 2 foxpro DBF files using union Pin
jkirkerx27-Oct-14 12:30
professionaljkirkerx27-Oct-14 12:30 
AnswerMakes no sense how it works Pin
jkirkerx27-Oct-14 13:01
professionaljkirkerx27-Oct-14 13:01 
QuestionSelect count on 2 DBF files Pin
jkirkerx27-Oct-14 11:11
professionaljkirkerx27-Oct-14 11:11 
GeneralRe: Select count on 2 DBF files Pin
PIEBALDconsult27-Oct-14 11:25
mvePIEBALDconsult27-Oct-14 11:25 
GeneralRe: Select count on 2 DBF files Pin
jkirkerx27-Oct-14 12:23
professionaljkirkerx27-Oct-14 12:23 
QuestionRewrit a Scalar function to a table valued function Pin
Ambertje21-Oct-14 0:00
Ambertje21-Oct-14 0:00 
AnswerRe: Rewrit a Scalar function to a table valued function Pin
Mycroft Holmes21-Oct-14 0:25
professionalMycroft Holmes21-Oct-14 0:25 
GeneralRe: Rewrit a Scalar function to a table valued function Pin
Ambertje21-Oct-14 1:40
Ambertje21-Oct-14 1:40 
GeneralRe: Rewrit a Scalar function to a table valued function Pin
Richard Deeming21-Oct-14 2:00
mveRichard Deeming21-Oct-14 2:00 
GeneralRe: Rewrit a Scalar function to a table valued function Pin
Ambertje21-Oct-14 2:25
Ambertje21-Oct-14 2:25 
GeneralRe: Rewrit a Scalar function to a table valued function Pin
Mycroft Holmes21-Oct-14 12:52
professionalMycroft Holmes21-Oct-14 12:52 
Ambertje wrote:
The view gets the data out of the bottom (STAGING) area in the form of text files.

Ah I thought you were doing something sensible, expecting performance from text files is not going to work.

I suggest you bulk copy the text files into staging tables, do attempt to apply transformations, and then use a stored proc to do the transforms from staging to your destination.

I would expect an order of magnitude performance gain with proper tuning of the staging indexes and procedure design. If the data is extreme you may want to look into dropping staging indexes before the insert and reimplementing them after import.

Doing transforms on the way in is a really lousy design, I know SSIS and all the tools do this but it is just wrong. Extract, Load, Transform
Never underestimate the power of human stupidity
RAH

SuggestionRe: Rewrit a Scalar function to a table valued function Pin
Richard Deeming21-Oct-14 1:55
mveRichard Deeming21-Oct-14 1:55 
AnswerRe: Rewrit a Scalar function to a table valued function Pin
Eddy Vluggen21-Oct-14 2:33
professionalEddy Vluggen21-Oct-14 2:33 
QuestionStored Procedure for Item Allotment Pin
avisharma@sharma19-Oct-14 20:01
avisharma@sharma19-Oct-14 20:01 
QuestionRe: Stored Procedure for Item Allotment Pin
Jörgen Andersson19-Oct-14 21:22
professionalJörgen Andersson19-Oct-14 21:22 
AnswerRe: Stored Procedure for Item Allotment Pin
avisharma@sharma19-Oct-14 23:04
avisharma@sharma19-Oct-14 23:04 
GeneralRe: Stored Procedure for Item Allotment Pin
Shweta N Mishra20-Oct-14 2:24
professionalShweta N Mishra20-Oct-14 2:24 
GeneralRe: Stored Procedure for Item Allotment Pin
avisharma@sharma27-Oct-14 2:42
avisharma@sharma27-Oct-14 2:42 
GeneralRe: Stored Procedure for Item Allotment Pin
Shweta N Mishra27-Oct-14 3:37
professionalShweta N Mishra27-Oct-14 3:37 
GeneralRe: Stored Procedure for Item Allotment Pin
Jörgen Andersson20-Oct-14 4:53
professionalJörgen Andersson20-Oct-14 4:53 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.