Singapore-based startup, #Percipient, has developed a way to sidestep a common #Hadoop big data function, thereby shortening query processing time by more than 15 times. Hadoop is an open source software framework that has enabled the world to embrace big data. Percipient’s flagship product, #UniConnect, unifies large volumes and varieties of data at high speed by leveraging on specific Hadoop technology. However, UniConnect replaces one of Hadoop’s core components, the #MapReduce model, with a revolutionary function called #SkipMR. By doing so, UniConnect is able to significantly boost its data processing speed. Tests in Percipient’s lab on a 16 GB Apple Macintoch desktop showed that using MapReduce, a single query of 1 million rows required 16 seconds, compared to under a second using UniConnect.
No comments:
Post a Comment