GRASP: A Sampling MetaHeuristic

1
GRASP A Sampling Meta-Heuristic

• Topics
• What is GRASP
• The Procedure
• Applications
• Merit

2
What is GRASP
GRASP Greedy Randomized Adaptive Search
Procedure Random Construction TSP randomly
select next city to add High Solution
Variance Low Solution Quality TSP randomly
select next city to add Greedy Construction
TSP select nearest city to add High Solution
Quality Low Solution Variance GRASP Tries
to Combine the Advantages of Random and Greedy
Solution Construction Together.
3
The Knapsack Example

• Knapsack problem
• Backpack 8 units of space, 4 items to pick
• Item Value in terms of dollars 2,5,7,9
• Item Cost in terms of space units 1,3,5,7
• Construction Heuristic
• Pick the Most Valuable Item
• Pick the Most Valuable Per Unit

4
Solution Quality

• Solution Quality
• For Heuristic 1 (1,4) , Value 11
• For Heuristic 2 (1,4), Value 11.
• Optimal Solution (2,3), Value 12
• None of them gives the Optimal solution
• This is true for any heuristic
• Theoretically, for a NP-Hard problem, there is no
  polynomial algorithm

5
Semi-Greedy Heuristics

• Add at each step, not necessarily the highest
  rated solution components
• Do the following
• Put high (not only the highest) solution
  components into a restricted candidate list (RCL)
  
• Choose one element of the RCL randomly and add it
  to the partial solution
• Adaptive element The greedy function depends on
  the partial solution constructed so far.
• Until a full solution is constructed.

6
Mechanism of RCL

• Size of the Restricted Candidate List
• 1) If we set size of the RCL to be really big,
  then the semi-greedy heuristic turns into a pure
  random heuristic
• 2) If we set the size of RCL to be 1, the
  sem-greedy heuristic turns into the pure greedy
  heuristic
• Typically, this size is set between 35.

7
GRASP

• Do the following
• Phase I Construct the current solution according
  to a greedy myopic measure of goodness (GMMOG)
  with random selection from a restricted candidate
  list
• Phase II Using a local search improvement
  heuristic to get better solutions
• While the stopping criteria unsatisfied

8
GRASP

• GRASP is a combination of semi-greedy heuristic
  with a local search procedure
• Local search from a Random Construction
• Best solution often better than greedy, if not
  too large prob.
• Average solution quality worse than greedy
  heuristic
• High variance
• Local Search from Greedy Construction
• Average solution quality better than random
• Low (No Variance)

9
The Knapsack Example

• Knapsack problem
• Backpack 8 units of space, 4 items to pick
• Item Value in terms of dollars 2,5,7,9
• Item Cost in terms of space units 1,3,5,7
• Two Greedy Functions
• Pick the Most Valuable Item
• Pick the Most Valuable Per Unit

10
GRASP

• The Most Valuable Item with RCL2
• Items 4 and 3 with values 9,7 are in the RCL
• Flip a coin, we select .
• The Most Valuable Per Unit with RCL 2
• Items 1 and 2 are selected with values 2/1 2 and
  5/3 1.7,
• Flip a coin, we select .

11
GRASP extensions

• Merits
• Fast
• High Quality Solution
• Time Critical Decision
• Few Parameters to tune
• Extension
• Reactive GRASP The RCL Size
• The use of Elite Solutions found
• Long term memory, Path relinking

12
Literature

• T.A.Feo and M.G.C. Resende, A probabilistic
  Heuristic for a computational Difficult Set
  covering Problem, Operations Research Letters,
  867-71, 1989
• P. Festa and M.G.C. Resende, GRASP An annotated
  Biblograph in P. Hansen and C.C. Ribeiro,
  editors, Essays and Surveys on Metaheuristics,
  Kluwer Academic Publishers, 2001
• M.G.C.Resende and C.C.Ribeiro, Greedy Randomized
  Adaptive Search Procedure, in Handbook of
  Metaheuristics, F. Glover and G. Kochenberger,
  eds, Kluwer Academic Publishers, 219-249, 2002