what is the fastest function in RDD spark -

-

i'm implementing groupby function , "transformations" operation.

i need groupby function must computed immediately, i've found out solution calling "action" likes first() or count() operation after groupby computed.

the running time of groupby equal + action operation, , need fastest function minimum total running time!!

thanks!

i assume doing performance testing kind of thing.so if right don't matter action returns,you need transformation(groupby) executed.
i think first() fastest rdd action can think of.

another approach can find time taken transformation(group by) alone in webui of spark.so can use rdd action wish!


Comments

Post a Comment

Popular posts from this blog

php - How can an email be returned from Stripe Checkout? -

-
using stripe, want store customer email address email supplied in checkout. unfortunately, posting stripeemail in charge.php file returns null . how can return email checkout can use send receipt? here's form code: <script src="https://checkout.stripe.com/v2/checkout.js"></script> <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.7.2/jquery.js"></script> <form action="charge.php" method="post"> <input type="hidden" id="amount" name="chargeamount"/> <button data-charge-amount="300000" data-charge-name="name" data-charge-description="description">select pledge level</button> <button data-charge-amount="123123" data-charge-name="name2" data-charge-description="description2">donate</button> </form> <script> $('button').click(function(){ var token...
Read more

SQL php on different pages to Insert (mysqli) -

-
i have piece of php code, works when placed on index page ( index.php ), nothing if put in page, i.e. add.php for example: having code add.php page, tried go to: www.myhost.com/add.php , nothing happen. if copy code index.php , go page www.myhost.com/index.php add row in sql table. why that? <?php $server="mysql.server.com"; $user="randomusr"; $pass="randompwd"; $db="randomdb"; $link=mysqli_connect($server, $user, $pass, $db); $result=mysqli_query($link,"select * `battery` `id`"); $query = "insert battery (id,type,owner,charge,time) values ('1','lily002','maisnow','15','2015-04-22 17:20:28')"; mysqli_query($link, $query); header("location: index.php"); //this 1 comment out when copied index.php ?> l # name type collation attributes null 1 id int(16) no ...
Read more

linked list - Get the index of the Node in a LinkedList which contains the given value in java -

-
i have linkedlist private linkedlist<node> vertices; here class node public class node { string value; linkedlist edges ; public node() { value=null; edges=new linkedlist(); } } now linkedlist mentioned above contains nodes in graph.what want pass string value method .this method should check if nodes in linkedlist contains node has value equal value passed .if should return index of node. here tried do public node getnode(string value) { int index=vertices.indexof(value);//this problem is. //index getting assigned value -1 return vertices.get(index); } and called method way temp2=getnode(header[dest]); but call method vertices.indexof(value) returning -1 (-1 shows not have . although has node has value equal value passed) . how check nodes matches value value pass . vertices of type node , passing string value. in node need implement equals method indexof method of linkedlist us...
Read more