New cloud platform enables cost-effective data engineering

Businesses encounter a variety of challenges in building systems on and around Spark to meet the needs of data engineering. Often engineers need to perform mission-critical data cleansing, transformations, and manipulations, to make business activities real-time dashboards or fraud detection possible. Mastering data engineering is therefore an essential step to automating systems and making data-driven decisions. Spark-based data science platform Databricks is launching a new edition of its cloud platform optimized specifically for data engineering workloads. Databricks for Data Engineering enables more cost-effective data engineering using Spark while empowering data engineers to easily combine SQL, structured streaming, Extract, Transform, Load… [Continue Reading]


Original URL: https://betanews.com/2017/04/12/cloud-data-engineering/

Original article

Actiance seeks to scoop up HP Autonomy customers

HP Enterprise’s announcement earlier this month that it was spinning off its ‘non-core’ software business, including the Autonomy big data solution to Micro Focus, has left many customers worried about the future. Archiving, analytics and compliance specialist Actiance is hoping to attract these users with the launch of an Autonomy Safe Landing Program, letting users easily transition to its Alcatraz archiving product. Alcatraz is a web-scale cloud archive designed from the ground up to store email and social communications in context. With fast search, high-performance import and exports, and robust APIs it lets companies discover insights while ensuring supervisory and surveillance workflows,… [Continue Reading]


Original URL: http://feeds.betanews.com/~r/bn/~3/Wf7pG9ybKlY/

Original article

Meet Apache Spot, a new open-source project for cybersecurity

Hard on the heels of the discovery of the largest known data breach in history, Cloudera and Intel on Wednesday announced that they’ve donated a new open-source project to the Apache Software Foundation with a focus on using big data analytics and machine learning for cybersecurity.
Originally created by Intel and launched as the Open Network Insight (ONI) project in February, the effort is now called Apache Spot and has been accepted into the ASF Incubator.
“The idea is, let’s create a common data model that any application developer can take advantage of to bring new analytic capabilities to bear on cybersecurity problems,” Mike Olson, Cloudera co-founder and chief strategy officer, told an audience at the Strata+Hadoop World show in New York. “This is a big deal, and could have a huge impact around the world.”To read this article in full or to leave a comment, please click here


Original URL: http://www.computerworld.com/article/3125121/security/meet-apache-spot-a-new-open-source-project-for-cybersecurity.html#tk.rss_all

Original article

Use Apache Spark? This tool can help you tap machine learning

Finding insight in oceans of data is one of enterprises’ most pressing challenges, and increasingly artificial intelligence is being brought in to help. Now, a new tool for Apache Spark aims to put machine learning within closer reach.
Announced Friday, Sparkling Water 2.0 is a major new update from H2O.ai that’s designed to make it easier for companies using Spark to bring machine-learning algorithms into their analyses. It’s essentially an API (application programming interface) that lets Spark users tap H2O’s open-source artificial-intelligence platform instead of — or alongside — the algorithms included in Spark’s own MLlib machine-learning library.To read this article in full or to leave a comment, please click here


Original URL: http://www.computerworld.com/article/3090998/data-analytics/use-apache-spark-this-tool-can-help-you-tap-machine-learning.html#tk.rss_all

Original article

Amazon’s Elastic File System is now open for business

Following an extended preview period, Amazon’s Elastic File System is now generally available in three geographical regions, with more on the way.
Originally announced last year, EFS is a fully managed elastic file storage service for deploying and scaling durable file systems in the Amazon Web Services cloud. It’s currently available in the U.S. East (northern Virginia), U.S. West (Oregon) and EU (Ireland) regions, the company announced Wednesday.
Customers can use EFS to create file systems that are accessible to multiple Amazon Elastic Compute Cloud (Amazon EC2) instances via the Network File System (NFS) protocol. They can also scale those systems up or down without needing to provision storage or throughput.To read this article in full or to leave a comment, please click here


Original URL: http://www.computerworld.com/article/3089382/big-data/amazons-elastic-file-system-is-now-open-for-business.html#tk.rss_all

Original article

Proudly powered by WordPress | Theme: Baskerville 2 by Anders Noren.

Up ↑

%d bloggers like this: