I was reading about partition switching. This is a new term to me, but I have been doing a lot of ready over the last hour. This may/may not be what I need, but wanted to get some inputs. (http://www.microsoft.com/technet/prodtechnol/sql/bestpractice/loading_bulk_data_partitioned_table.mspx)...
Ah! I like the view idea. I will explore.
This load process is a little different from what I am used to. This data is coming from a mainframe computer. I am actually supplied with nightly flat files in which I merge into this table (new and updated rows). However, we receive the weekend file...
SQL Server 2005
I need to import two flat files (.txt). Combined, these two files contain over 14 million rows. I need to load these files every weekend which will replace the destination table completely. I need to do this with as little impact on the destination table as possible (as far as...
Looks like I might be experiencing a term called "race condition - when two or more threads perform an operation, and the result of the operation depends on unpredictable timing factors; when each thread completes the operation".
This is all very new to me, so I am going to sleep on it. Anyone...
So I find out that the file system watcher component is responding as it should. There are multiple events fired when a transaction like this occurs. The trick is to find a way to ignore/avoid the multiple events. This is what I came up with below.
I do have a problem I hope someone can help...
sql server 2005
vb.net
I have a vb.net program that imports data. There is a call to a stored procedure that uses a Bulk Insert Command. I am using the MAXERRORS and ERRORFILE Arguements. MAXERRORS = 10. If I do not reach the 10 errors, I want the bad records to write to my ERRORFILE.
This...
I also should have mentioned that this code is broken down for posting purposes. I do have this code in a windows service application. I thought this code would display what I have and trying to do. If anyone wants the all of my code, I can post that. (But this time in the code blocks.)
I originally posted in the asp.net forum and realized that this should probably be in this forum. Sorry for reposting here.
Original post - thread855-1450101
I have been away from this code for a few days. I am back working on this. I have tried a few different variations of the code below. I...
When testing I am just using any file I have available with an extension in the defined String() above - gblpvFilters. [ex: myTest.txt].
I have been doing some reading. I find that using Notepad to test with may be my first problem. From my reading: Notepad performs multiple file system actions...
I am trying to use the FileSystemWatcher class to move files around. I only want to move files if the LastWrite time (Date Modified) of a file changes in a particular directory. In other words; move the file if it is a new one. The problem is that when I add a new file to this directory, it...
I reference the FAQ of this forum (faq183-1602). I did reference this earlier, but thought I would be fancy and skip using the dummy server column names as stated in the FAQ. Got it working once I used the format in the FAQ.
I checked for extra lines and spaces. Everything is clear there. I even tried to strip my csv file down to 1 row and 3 columns and the same changes to my format file.
This is an example of my formatfile:
9.0
27
1 SQLCHAR 0 50 "','" 1 ID SQL_Latin1_General_CP1_CI_AS
2 SQLCHAR 0 50 "','" 2 Fname SQL_Latin1_General_CP1_CI_AS
3 SQLCHAR 0 50 "','" 3 Lname SQL_Latin1_General_CP1_CI_AS
...
Should have mentioned that I am using the BULK INSERT command.
BULK INSERT ##TEST FROM '\\myLocation\myfile.csv' WITH
(
FORMATFILE = '\\mylocation\ffLeads.txt'
)
SQL Server 9.0
I'm attempting to import data from a CSV file with double quotes around each filed. I created a formatfile and placed it in the same directory the CSV file is located. I have load files from this directory before, but without a formatfile. This is the error I receive in sql...
I looked into the Binary_Checksum function and checksum_agg function. These functions would work great on telling me that my tables are different. In this case, my tables will always be different. Since my current table is constantly having data appended to it.
This is what I am testing right...
Thank you for your response. This article seems to work if I know the tables I am working with. The SP that I use that performs this data import is used for many tables. So my SP does not know column names or existing keys. All my SP has are two identical table structures with data. One...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.