Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Allocating independent subtasks on parallel processors
Kruskal C., Weiss A. IEEE Transactions on Software EngineeringSE-11 (10):1001-1016,1985.Type:Article
Date Reviewed: Apr 1 1987

This paper considers the following problem: In a fork:.RW.5 :.US and:.US join type of situation, n independent subtasks arise which can be assigned to p parallel processors. Allocation of subtasks to a processor is in batches of K subtasks, each batch allocation inducing some overhead h. What is the impact of K (on total finishing time, on efficiency, etc.)? Here is the stochastic setting: All subtask processing times are identically distributed (mean &mgr;, variance 62), and all overhead times are identically distributed. Assuming “increasing failure rate” distributions for subtask times and “infinitely divisible” distributions for overhead times, the paper derives, as the central result, a formula for the expected total finishing time, E [ T ], asymptotically correct for large parameter values, in particular for large n &slash; p.

Due to a number of nonstandard derivations and intermediate results, the paper is interesting to read from a theoretical point of view. For the practitioner, it will be comforting news that the result for E [ T ] consists of two additive terms (overhead h deterministic):

(1) the first term, ( n &slash; p ) &dundot; μ + ( n &dundot; h ) &slash; ( p &dundot; K ), coinciding with the obvious guess, and
(2) the second, corrective term, &sgr; &dundot; &sqrt;2 K &dundot; log ( p ), being considered relatively small, by the authors.
Also, simulation results indicate a certain “robustness” of the E [ T ] formula beyond the assumed class of distributions, and for smaller parameter values. Hence, the particular choice of K could not do much harm, and minimization of overhead would lead to the “one batch per processor,” K ≈ n &slash; p, decision.

On the other hand, I was not able to verify the various included graphs, E [ T ] vs. K, numerically against the given formula. The formula’s corrective term appears to me larger than depicted. This observation would conform with one of the authors’ concluding remarks that “significant improvement” in efficiency is possible by moving from fixed size batches to variable size batches; though it would somehow contradict the statement that “total time changes relatively little” with K.

Reviewer:  H. Beilner Review #: CR110177
Bookmark and Share
 
Performance (D.4.8 )
 
 
Parallel Processors (C.1.2 ... )
 
 
Scheduling (D.4.1 ... )
 
 
Performance of Systems (C.4 )
 
Would you recommend this review?
yes
no
Other reviews under "Performance": Date
Buffer allocation strategies with blocking requirements
Yum T., Dou C. Performance Evaluation 4(4): 285-295, 1984. Type: Article
Aug 1 1985
P.S. to operating systems
Dowdy L., Lowery C., Prentice-Hall, Inc., Upper Saddle River, NJ, 1993. Type: Book (9780130116857)
Jun 1 1994
Markov analysis of multiple-disk prefetching strategies for external merging
Pai V., Schäffer A., Varman P. Theoretical Computer Science 128(1-2): 211-239, 1994. Type: Article
Jun 1 1995
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy