Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations strongm on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Rounding problem large dataset.

Status
Not open for further replies.

PantoKing

Technical User
Nov 28, 2001
169
GB
Hello,

I am currently having a problem with rounding of a large dataset (1.5 million records). I have run the round function to 2 decimal places and every record seems fine. However when I sum these rounded records i am getting additional decimal places. i.e. .0299958.

Has anyone got any ideas what may sort this problem.

Thanks in advance!

Make things as simple as possible — but no simpler. [pc3]
 
Check the data types of your fields. If they are floating point types (Single or Double) then note that a float may not be able to exactly represent a decimal number. Try converting them to scaled integer types (Currency or Decimal).
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top