AMPLab Shark on Apache Spark

As per documentation,

"Apache Spark is a fast and general engine for large-scale data processing."

"Shark is an open source distributed SQL query engine for Hadoop data."

And Shark uses Spark as a dependency.

My question is, Is Spark just parses HiveQL into Spark jobs or does anything great if we use Shark for fast response on analytical queries ?

Answers


Yes, Shark uses the same idea as Hive but translates HiveQL into Spark jobs instead of MapReduce jobs. Please, read pages 13-14 of this document for architectural differences between these two.


Need Your Help

How do I use TextWatcher to check for a specific string of characters instead of just one character?

java android android-edittext textwatcher

I'm new to both Android and Java. My app needs to be able to check what the user is typing as they are typing it. If the user types in a predetermined word that has been flagged, an event needs to ...

C Check when 2D-Int array is full

c arrays microcontroller

I want check in my 2 Dimensional array when it is full.

About UNIX Resources Network

Original, collect and organize Developers related documents, information and materials, contains jQuery, Html, CSS, MySQL, .NET, ASP.NET, SQL, objective-c, iPhone, Ruby on Rails, C, SQL Server, Ruby, Arrays, Regex, ASP.NET MVC, WPF, XML, Ajax, DataBase, and so on.