refactor!: make Position generic over offset type

Previously Span was generic over R just
so that it could provide the method:

    fn from_reader(reader: &R) -> Self;

and properly implementing that method again
relied on R implementing the Position trait:

    impl<P: Position> Span<P> for Range<usize> { .. }

which was a very roundabout and awkward way of doing things.

It makes much more sense to make the Position trait generic
over the return type of its method (which previously always had
to be usize). Which lets us provide a blanket implementation:

    impl<R: Reader> Position<NoopOffset> for R { .. }

1 files changed, 1 insertions, 0 deletions

diff --git a/src/tokenizer.rs b/src/tokenizer.rs
index 7768ee4..7b8b1ce 100644
--- a/src/tokenizer.rs
+++ b/src/tokenizer.rs
@@ -1,5 +1,6 @@
 use crate::machine;
 use crate::reader::{IntoReader, Reader};
+use crate::spans::Position;
 use crate::utils::{
     control_pat, noncharacter_pat, surrogate_pat, ControlToken, State as InternalState,
 };