proc_macro

The tracking issue for this feature is: #38356


This feature flag guards the new procedural macro features as laid out by RFC 1566, which alongside the now-stable custom derives, provide stabilizable alternatives to the compiler plugin API (which requires the use of perma-unstable internal APIs) for programmatically modifying Rust code at compile-time.

The two new procedural macro kinds are:

  • Function-like procedural macros which are invoked like regular declarative macros, and:

  • Attribute-like procedural macros which can be applied to any item which built-in attributes can be applied to, and which can take arguments in their invocation as well.

Additionally, this feature flag implicitly enables the use_extern_macros feature, which allows macros to be imported like any other item with use statements, as compared to applying #[macro_use] to an extern crate declaration. It is important to note that procedural macros may only be imported in this manner, and will throw an error otherwise.

You must declare the proc_macro feature in both the crate declaring these new procedural macro kinds as well as in any crates that use them.

Common Concepts

As with custom derives, procedural macros may only be declared in crates of the proc-macro type, and must be public functions. No other public items may be declared in proc-macro crates, but private items are fine.

To declare your crate as a proc-macro crate, simply add:

[lib]
proc-macro = true

to your Cargo.toml.

Unlike custom derives, however, the name of the function implementing the procedural macro is used directly as the procedural macro's name, so choose carefully.

Additionally, both new kinds of procedural macros return a TokenStream which wholly replaces the original invocation and its input.

Importing

As referenced above, the new procedural macros are not meant to be imported via #[macro_use] and will throw an error if they are. Instead, they are meant to be imported like any other item in Rust, with use statements:

#![feature(proc_macro)]

// Where `my_proc_macros` is some crate of type `proc_macro`
extern crate my_proc_macros;

// And declares a `#[proc_macro] pub fn my_bang_macro()` at its root.
use my_proc_macros::my_bang_macro;

fn main() {
    println!("{}", my_bang_macro!());
}

Error Reporting

Any panics in a procedural macro implementation will be caught by the compiler and turned into an error message pointing to the problematic invocation. Thus, it is important to make your panic messages as informative as possible: use Option::expect instead of Option::unwrap and Result::expect instead of Result::unwrap, and inform the user of the error condition as unambiguously as you can.

TokenStream

The proc_macro::TokenStream type is hardcoded into the signatures of procedural macro functions for both input and output. It is a wrapper around the compiler's internal representation for a given chunk of Rust code.

Function-like Procedural Macros

These are procedural macros that are invoked like regular declarative macros. They are declared as public functions in crates of the proc_macro type and using the #[proc_macro] attribute. The name of the declared function becomes the name of the macro as it is to be imported and used. The function must be of the kind fn(TokenStream) -> TokenStream where the sole argument is the input to the macro and the return type is the macro's output.

This kind of macro can expand to anything that is valid for the context it is invoked in, including expressions and statements, as well as items.

Note: invocations of this kind of macro require a wrapping [], {} or () like regular macros, but these do not appear in the input, only the tokens between them. The tokens between the braces do not need to be valid Rust syntax.

my_macro_crate/src/lib.rs

#![feature(proc_macro)]

// This is always necessary to get the `TokenStream` typedef.
extern crate proc_macro;

use proc_macro::TokenStream;

#[proc_macro]
pub fn say_hello(_input: TokenStream) -> TokenStream {
    // This macro will accept any input because it ignores it. 
    // To enforce correctness in macros which don't take input,
    // you may want to add `assert!(_input.to_string().is_empty());`.
    "println!(\"Hello, world!\")".parse().unwrap()
}

my_macro_user/Cargo.toml

[dependencies]
my_macro_crate = { path = "<relative path to my_macro_crate>" }

my_macro_user/src/lib.rs

#![feature(proc_macro)]

extern crate my_macro_crate;

use my_macro_crate::say_hello;

fn main() {
    say_hello!();
}

As expected, this prints Hello, world!.

Attribute-like Procedural Macros

These are arguably the most powerful flavor of procedural macro as they can be applied anywhere attributes are allowed.

They are declared as public functions in crates of the proc-macro type, using the #[proc_macro_attribute] attribute. The name of the function becomes the name of the attribute as it is to be imported and used. The function must be of the kind fn(TokenStream, TokenStream) -> TokenStream where:

The first argument represents any metadata for the attribute (see the reference chapter on attributes). Only the metadata itself will appear in this argument, for example:

  • #[my_macro] will get an empty string.
  • #[my_macro = "string"] will get = "string".
  • #[my_macro(ident)] will get (ident).
  • etc.

The second argument is the item that the attribute is applied to. It can be a function, a type definition, an impl block, an extern block, or a module—attribute invocations can take the inner form (#![my_attr]) or outer form (#[my_attr]).

The return type is the output of the macro which wholly replaces the item it was applied to. Thus, if your intention is to merely modify an item, it must be copied to the output. The output must be an item; expressions, statements and bare blocks are not allowed.

There is no restriction on how many items an attribute-like procedural macro can emit as long as they are valid in the given context.

my_macro_crate/src/lib.rs

#![feature(proc_macro)]

extern crate proc_macro;

use proc_macro::TokenStream;

/// Adds a `/// ### Panics` docstring to the end of the input's documentation
///
/// Does not assert that its receiver is a function or method.
#[proc_macro_attribute]
pub fn panics_note(args: TokenStream, input: TokenStream) -> TokenStream {
    let args = args.to_string();
    let mut input = input.to_string();

    assert!(args.starts_with("= \""), "`#[panics_note]` requires an argument of the form \
                                       `#[panics_note = \"panic note here\"]`");

    // Get just the bare note string
    let panics_note = args.trim_matches(&['=', ' ', '"'][..]);

    // The input will include all docstrings regardless of where the attribute is placed,
    // so we need to find the last index before the start of the item
    let insert_idx = idx_after_last_docstring(&input);

    // And insert our `### Panics` note there so it always appears at the end of an item's docs
    input.insert_str(insert_idx, &format!("/// # Panics \n/// {}\n", panics_note));

    input.parse().unwrap()
}

// `proc-macro` crates can contain any kind of private item still
fn idx_after_last_docstring(input: &str) -> usize {
    // Skip docstring lines to find the start of the item proper
    input.lines().skip_while(|line| line.trim_left().starts_with("///")).next()
        // Find the index of the first non-docstring line in the input
        // Note: assumes this exact line is unique in the input
        .and_then(|line_after| input.find(line_after))
        // No docstrings in the input
        .unwrap_or(0)
}

my_macro_user/Cargo.toml

[dependencies]
my_macro_crate = { path = "<relative path to my_macro_crate>" }

my_macro_user/src/lib.rs

#![feature(proc_macro)]

extern crate my_macro_crate;

use my_macro_crate::panics_note;

/// Do the `foo` thing.
#[panics_note = "Always."]
pub fn foo() {
    panic!()
}

Then the rendered documentation for pub fn foo will look like this:

pub fn foo()


Do the foo thing.

Panics

Always.