IDEALS Home University of Illinois at Urbana-Champaign logo The Alma Mater The Main Quad

Hypergraph-Based Combinatorial Optimization of Matrix-Vector Multiplication

Show full item record

Bookmark or cite this item: http://hdl.handle.net/2142/13069

Files in this item

File Description Format
PDF mmwolfThesisFinal.pdf (1MB) Ph.D. Thesis PDF
Title: Hypergraph-Based Combinatorial Optimization of Matrix-Vector Multiplication
Author(s): Wolf, Michael M.
Doctoral Committee Chair(s): Heath, Michael T.
Doctoral Committee Member(s): Boman, Erik G.; Erickson, Jeff; Gropp, William D.; Olson, Luke N.
Department / Program: Computer Science
Discipline: Computer Science
Degree Granting Institution: University of Illinois at Urbana-Champaign
Degree: Ph.D.
Genre: Dissertation
Subject(s): matrix-vector multiplication hypergraphs combinatorial optimization parallel data distributions finite elements sparse matrix computations combinatorial scientific computing
Abstract: Combinatorial scientific computing plays an important enabling role in computational science, particularly in high performance scientific computing. In this thesis, we will describe our work on optimizing matrix-vector multiplication using combinatorial techniques. Our research has focused on two different problems in combinatorial scientific computing, both involving matrix-vector multiplication, and both are solved using hypergraph models. For both of these problems, the cost of the combinatorial optimization process can be effectively amortized over many matrix-vector products. The first problem we address is optimization of serial matrix-vector multiplication for relatively small, dense matrices that arise in finite element assembly. Previous work showed that combinatorial optimization of matrix-vector multiplication can lead to faster assembly of finite element stiffness matrices by eliminating redundant operations. Based on a graph model characterizing row relationships, a more efficient set of operations can be generated to perform matrix-vector multiplication. We improved this graph model by extending the set of binary row relationships and using hypergraphs to model more complicated row relationships, yielding significantly improved results over previous models. The second problem we address is parallel matrix-vector multiplication for large sparse matrices. Parallel sparse matrix-vector multiplication is a particularly important numerical kernel in computational science. We have focused on optimizing the parallel performance of this operation by reducing the communication volume through smarter, two-dimensional matrix partitioning. We have developed and implemented a recursive algorithm based on nested dissection to partition structurally symmetric matrices. In general, this method has proven to be the best available for partitioning structurally symmetric matrices (when considering both volume and partitioning time) and has shown great promise for information retrieval matrices. We also developed a second, simpler method that is fast and works well for many symmetric matrices.
Issue Date: 2009-07-11
Genre: Dissertation / Thesis
Type: TextOther
Language: English
URI: http://hdl.handle.net/2142/13069
Publication Status: unpublished
Peer Reviewed: is peer reviewed
Date Available in IDEALS: 2009-07-11
 

This item appears in the following Collection(s)

Show full item record

Item Statistics

  • Total Downloads: 150
  • Downloads this Month: 0
  • Downloads Today: 0

Browse

My Account

Information

Access Key