File tree Expand file tree Collapse file tree 1 file changed +5
-4
lines changed Expand file tree Collapse file tree 1 file changed +5
-4
lines changed Original file line number Diff line number Diff line change 66//! produces simple tokens which are a pair of type-tag and a bit of original text,
77//! and does not report errors, instead storing them as flags on the token.
88//!
9- //! Tokens produced by this lexer are not yet ready for parsing the Rust syntax,
10- //! for that see `librustc_parse::lexer`, which converts this basic token stream
9+ //! Tokens produced by this lexer are not yet ready for parsing the Rust syntax.
10+ //! For that see [ `librustc_parse::lexer`] , which converts this basic token stream
1111//! into wide tokens used by actual parser.
1212//!
1313//! The purpose of this crate is to convert raw sources into a labeled sequence
1414//! of well-known token types, so building an actual Rust token stream will
1515//! be easier.
1616//!
17- //! Main entity of this crate is [`TokenKind`] enum which represents common
17+ //! The main entity of this crate is the [`TokenKind`] enum which represents common
1818//! lexeme types.
19-
19+ //!
20+ //! [`librustc_parse::lexer`]: ../rustc_parse/lexer/index.html
2021// We want to be able to build this crate with a stable compiler, so no
2122// `#![feature]` attributes should be added.
2223
You can’t perform that action at this time.
0 commit comments