--- title: Hadoop Data Lake description: Internet giants like Google and Yahoo had managed to maintain and increase responsiveness, providing new real-time capabilities when others were challenged with delivering weekly refreshes, let alone image: https://resource.nexj.com/hubfs/Hadoop_Data_Lake-768x367.png --- [![nexj-white-blue](https://resource.nexj.com/hs-fs/hubfs/nexj-white-blue.png?width=140&name=nexj-white-blue.png "nexj-white-blue")](https://www.nexj.com) [Back to Corporate Website](https://www.nexj.com/) [TOPIC // Insurance](https://resource.nexj.com/blog/tag/insurance) # Hadoop Data Lake - - - In this blog series, we’ll explore the concepts that make up the Semantic Data Lake. We’ll begin with an introduction to **Hadoop** – what is it and why was it developed? Techniques traditionally applied when mastering complicated organizational reference data such as customers often require centralization to enforce standardization.  Time to construct and maintain these solutions diminishes organizational responsiveness in many large organizations, because building large scale data warehouses or message integration solutions requires enormous investments in resources and patience to yield value. Alternatives were needed -- spurred by the growth in the digital economy, agility and flexibility have become critical success factors to enabling digital transformation initiatives. Internet giants like Google and Yahoo had managed to maintain and increase responsiveness, providing new real-time capabilities when others were challenged with delivering weekly refreshes, let alone daily refreshes or streaming data. Well understood data warehousing techniques that necessitated replication and restructuring of data could simply not be applied - the volumes were far too large and the time required to process into a defined structure were not available. Instead, these giants developed open source technologies, the cornerstone of which today is commonly known as Hadoop. The basic premise behind Hadoop was to provide in-place query capabilities leveraging a cluster of servers based on commodity hardware. This direction was contrarian in many ways. But architectures and databases aside, the critical Hadoop success factor was its inherent ability to send the algorithm to the data and not the traditional reshaping techniques that sought to centralize data for processing. In the video above, we illustrate the query in place capability of Hadoop on commodity hardware. Hive is used as a programmatic interface where a SQL-like script is developed.  The script when executed would generate corresponding Map/Reduce scripts that are directed to the nodes containing required files. Scripts are executed and results compiled and returned to the Hive interface. Note that these are all native Hadoop features that do not require additional developer intervention. This critical concept of sending the algorithm to the data coupled with the ability to query contents without restructuring was foundational in the definition of the Hadoop Data Lake. Join us next time where we see how organizations have learned to leverage operational savings in cost reduction and cost avoidance and applied them to optimization efforts capitalized from 360 data views.  How does your organization use a Data Lake?  What 360 data views power your analytics?  We welcome your thoughts, value your insights and action your feedback: share below! **Tags:** [Insurance](https://resource.nexj.com/blog/tag/insurance), [Corporate Banking](https://resource.nexj.com/blog/tag/corporate-banking), [Commercial Banking](https://resource.nexj.com/blog/tag/commercial-banking), [Capital Markets](https://resource.nexj.com/blog/tag/capital-markets), [Wealth Management](https://resource.nexj.com/blog/tag/wealth-management), [Private Banking](https://resource.nexj.com/blog/tag/private-banking) Share: - - - PREVIOUS POST [Beyond the Brochure - Why Project Success Begins with the Proof of Concept](https://resource.nexj.com/blog/2017/05/04/beyond-the-brochure-why-project-success-begins-with-the-proof-of-concept) [![](https://cdn2.hubspot.net/hubfs/5152923/Creative_Theme/image/chevron.png)](https://resource.nexj.com/blog) Next Post [Key Takeaways from the CGI 2017 Connections Conference](https://resource.nexj.com/blog/2017/05/18/key-takeaways-from-the-cgi-2017-connections-conference) Content Title Description ### Don't Miss Out Subscribe Today! ### Search Our Blog ### Categories - [Advisors (15)](https://resource.nexj.com/blog/tag/advisors) - [Artificial Intelligence (40)](https://resource.nexj.com/blog/tag/artificial-intelligence) - [Capital Markets (54)](https://resource.nexj.com/blog/tag/capital-markets) - [client engagement (3)](https://resource.nexj.com/blog/tag/client-engagement) - [client lifecycle management (1)](https://resource.nexj.com/blog/tag/client-lifecycle-management) - [client-focused reforms (1)](https://resource.nexj.com/blog/tag/client-focused-reforms) - [clm (1)](https://resource.nexj.com/blog/tag/clm) - [Commercial Banking (62)](https://resource.nexj.com/blog/tag/commercial-banking) - [Company News (3)](https://resource.nexj.com/blog/tag/company-news) - [Corporate Banking (65)](https://resource.nexj.com/blog/tag/corporate-banking) - [CRM (33)](https://resource.nexj.com/blog/tag/crm) - [Financial Services (1)](https://resource.nexj.com/blog/tag/financial-services) - [Gartner (1)](https://resource.nexj.com/blog/tag/gartner) - [IAD (11)](https://resource.nexj.com/blog/tag/iad) - [IBM (2)](https://resource.nexj.com/blog/tag/ibm) - [Increase Customer Loyalty (4)](https://resource.nexj.com/blog/tag/increase-customer-loyalty) - [Insurance (24)](https://resource.nexj.com/blog/tag/insurance) - [integrated advisor desktop (1)](https://resource.nexj.com/blog/tag/integrated-advisor-desktop) - [integration (3)](https://resource.nexj.com/blog/tag/integration) - [Optimize Processes (35)](https://resource.nexj.com/blog/tag/optimize-processes) - [Private Banking (60)](https://resource.nexj.com/blog/tag/private-banking) - [Retain Top Talent (1)](https://resource.nexj.com/blog/tag/retain-top-talent) - [robo-advisors (1)](https://resource.nexj.com/blog/tag/robo-advisors) - [Salesforce (1)](https://resource.nexj.com/blog/tag/salesforce) - [User Adoption (14)](https://resource.nexj.com/blog/tag/user-adoption) - [vertical cloud (2)](https://resource.nexj.com/blog/tag/vertical-cloud) - [Wealth Management (118)](https://resource.nexj.com/blog/tag/wealth-management) See all ### Popular Posts [The Dashboard for Everything a Financial Advisor Does: A Closer Look at NexJ’s Advisor Dashboard](https://resource.nexj.com/blog/the-dashboard-for-everything-a-financial-advisor-does-a-closer-look-at-nexjs-advisor-dashboard) [NexJ Systems Inc.](https://resource.nexj.com/blog/author/superadminsystems9) - Mar 25, 2022 [How Important Is A Concierge Service In Private Banking? An interview with Andrew Cant, VP, Financial Services Solutions](https://resource.nexj.com/blog/2020/01/27/how-important-is-a-concierge-service-in-private-banking-an-interview-with-andrew-cant-vp-financial-services-solutions) [NexJ Systems Inc.](https://resource.nexj.com/blog/author/superadminsystems9) - Jan 27, 2020 [Servicing the Client Across Their Journey](https://resource.nexj.com/blog/2017/03/14/servicing-the-customer-across-their-journey) [Adam Edmonds](https://resource.nexj.com/blog/author/adam-edmonds) - Mar 14, 2017 ## Related Posts - - - ## [How Your CRM Manages Relationship Hierarchy Can Define How Well You Know Your Customers](https://resource.nexj.com/blog/how-your-crm-manages-relationship-hierarchy-can-define-how-well-you-know-your-customers) ## Don't capsize your client relationships with poor info! Trying to tell corporate and investment bankers about the importance of understanding their customers is a lot like listing the benefits of butter to a pastry chef. They get it. They know it really, really well. And yet, considering we are in the business of Customer Relationship Management, I sometimes can’t help but question what this means. [Read Post](https://resource.nexj.com/blog/how-your-crm-manages-relationship-hierarchy-can-define-how-well-you-know-your-customers) - - - ## [Here’s How Leveraging Client Information Can Help You Become The Banker of Choice](https://resource.nexj.com/blog/2020/03/05/heres-how-leveraging-client-information-can-help-you-become-the-banker-of-choice) **Innovation and a global approach** [Read Post](https://resource.nexj.com/blog/2020/03/05/heres-how-leveraging-client-information-can-help-you-become-the-banker-of-choice) - - - ## [When It Comes To CRM, User Adoption Is Always A Challenge. Here's How One Of Our Biggest Clients Pulled It Off](https://resource.nexj.com/blog/2020/02/28/when-it-comes-to-crm-user-adoption-is-always-a-challenge-heres-how-one-of-our-biggest-clients-pulled-it-off) You may have the best possible CRM solution on the market, a deep vertical award-winning software geared to meet your every need. What you will always struggle with is poor [user ](https://www.nexj.com/industry-solutions/topics/user-adoption-for-financial-services-crm/)adoption. [Read Post](https://resource.nexj.com/blog/2020/02/28/when-it-comes-to-crm-user-adoption-is-always-a-challenge-heres-how-one-of-our-biggest-clients-pulled-it-off) Stay Informed ## subscribe **today** ![16](https://cdn2.hubspot.net/hub/5152923/hubfs/HP_Theme/images/16.jpg?width=3953&name=16.jpg "16") ![nexj-white](https://resource.nexj.com/hs-fs/hubfs/nexj-white.png?width=90&name=nexj-white.png "nexj-white") NexJ Systems, the pioneer of Intelligent Customer Management, is the trusted partner for CRM products by global financial services institutions due to their deep domain expertise, next-generation technology, strategic investment in innovation, and strong commitment to customer success. ## Industry Solutions - [CRM for Wealth Management](https://www.nexj.com/industry-solutions/wealth-management/) - [CRM for Private Banking](https://www.nexj.com/industry-solutions/private-banking/) - [CRM for Sales, Trading & Research](https://www.nexj.com/industry-solutions/sales-trading-and-research/) - [CRM for Commercial Banking](https://www.nexj.com/industry-solutions/commercial-banking/) - [CRM for Corporate Banking](https://www.nexj.com/industry-solutions/corporate-banking/) - [CRM for Insurance](https://www.nexj.com/industry-solutions/insurance/) ## Our Company - [About Us](https://www.nexj.com/company/about-nexj-systems/) - [Investor Relations](https://www.nexj.com/company/investor-relations/) - [Analyst Coverage](https://www.nexj.com/company/analyst-coverage/) - [Leadership](https://www.nexj.com/company/management-team-board-members/) - [Partners](https://www.nexj.com/company/partner-program/) - [Press Room](https://www.nexj.com/company/press-room/) ## Resource Center - [White Papers](https://www.nexj.com/resources/white-paper/) - [Analyst Reports](https://www.nexj.com/resources/industry-analyst-reports/) - [Brochures](https://www.nexj.com/resources/brochure/) - [Case Studies](https://www.nexj.com/resources/case-studies/) - [Videos](https://www.nexj.com/resources/video/) - [Webinars](https://www.nexj.com/resources/webinar/) ## Contact us [Info@nexj.com](mailto:Info@nexj.com) NexJ Systems Inc. 10 York Mills Road, Suite 700 Toronto, Ontario M2P 2G4 Canada P: +1 (416) 222-5611 F: +1 (416) 222-8623 - [Facebook](http://www.facebook.com) - [Twitter](http://www.twitter.com) - [Linkedin](http://www.linkedin.com) - [YouTube](https://www.youtube.com/user/nexjsystems/) #### Related CRM Topics for the Finance & Insurance Industry - [BPM Software](https://www.nexj.com/industry-solutions/topics/business-process-management-bpm-software/) - [Client Lifecycle Management](https://www.nexj.com/industry-solutions/topics/client-lifecycle-management/) - [Contact Centre CRM](https://www.nexj.com/industry-solutions/topics/contact-centre-crm-software/) - [Digital Engagement](https://www.nexj.com/industry-solutions/topics/digital-engagement/) - [Financial Advisor CRM](https://www.nexj.com/industry-solutions/topics/crm-for-financial-advisors/) - [Financial Services CRM](https://www.nexj.com/industry-solutions/topics/crm-for-financial-services/) - [Intelligent Customer Management](https://www.nexj.com/industry-solutions/intelligent-customer-management/) - [MiFID II Compliance](https://www.nexj.com/industry-solutions/topics/mifid-ii-compliance-for-wealth-management-and-private-banking/) - [Suitability & Appropriateness](https://www.nexj.com/industry-solutions/topics/suitability-and-appropriateness/) - [User Adoption for CRM](https://www.nexj.com/industry-solutions/topics/user-adoption-for-financial-services-crm/) Copyright © 2026 NexJ Systems Inc. All Rights Reserved. ![](https://ws.zoominfo.com/pixel/JhhNmN2VoGY4qqP29rjm) ![](https://dc.ads.linkedin.com/collect/?pid=205626&fmt=gif) ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Matthew Bogart", "url" : "https://resource.nexj.com/blog/author/matthew-bogart" }, "dateModified" : "2020-06-24T20:56:20.473Z", "datePublished" : "2017-05-11T14:37:23.000Z", "headline" : "Hadoop Data Lake", "image" : [ "https://resource.nexj.com/hubfs/Hadoop_Data_Lake-768x367.png" ], "mainEntityOfPage" : { "@id" : "https://resource.nexj.com/blog/2017/05/11/hadoop-data-lake", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://resource.nexj.com/hubfs/nexj.png" }, "name" : "NexJ Systems Inc." } } ```