I don't particularly know how to help you, but this topic might be interesting as you mention "large dataset":