Using Program Structure to Achieve Prefetching for Cache Memories

Brent, Glen Alan

Permalink

https://hdl.handle.net/2142/126867 Copy

Description

Title

Using Program Structure to Achieve Prefetching for Cache Memories

Author(s)

Brent, Glen Alan

Issue Date

1987-01

Keyword(s)

architecture, memory-design, cache memory, memory prefetching, program analysis

Date of Ingest

2025-03-25T14:02:35-05:00

Abstract

A concise program structure notation, called a program skeleton, is developed that can be used for program analysis, or if machine-specific details are included, for memory prefetching. The program skeleton describes the structure of the source code as well as the low-level accessing behavior. Transformations are developed to create a machine-specific cache memory prefetching control program, called the prefetch skeleton (PFS), from the program skeleton. A prefetching unit (PFU) is developed as a simple in-cache processor. The PFU executes the PFS and generates cache line prefetch requests ahead of CPU demand requests. A variety of PFS-cache machines are simulated in detail to demonstrate the feasibility of the PFS prefetcher. Instruction miss delays can be reduced significantly by using a PFS-cache. Some reduction in data miss delays is also obtained even though the PFS as developed in this initial research focuses primarily on instruction prefetching. The PFS prefetching scheme improves cache performance without requiring programmer involvement, since the PFS is generated automatically. By the compiler as it compiles the source program. The PFS concept is compatible with a variety of programming languages. The PFS-cache machine is capable of running non-PFS programs, although better performance is obtained when the programs are recompiled to create the PFS.

Publisher

Center for Supercomputing Research and Development, University of Illinois at Urbana-Champaign

Series/Report Name or Number

CSRD-647, UILU-ENG-87-8001

Type of Resource

text

Genre of Resource

technical report

Language

eng

Sponsor(s)/Grant Number(s)

National Science Foundation- NSF DCR84-10110; NSF DCR85-09970; U.S. Department of Energy- DOE DE-FG02-85ER25001; IBM Corp. Resident Study Program

Copyright and License Information

University of Illinois Board of Trustees

Owning Collections