This is a modern library for working with URIs in Haskell as per RFC 3986:
https://tools.ietf.org/html/rfc3986
The modern-uri package features:
- Correct by construction
URIdata type. The correctness is ensured by making sure that every sub-component of theURIrecord cannot be invalid. - Textual components in the
URIdata type are represented asTextrather thanByteString, because they are percent-decoded and so they can contain characters outside of ASCII range (i.e. Unicode). This allows for easier manipulation ofURIs, while encoding and decoding headaches are handled by the parsers and renders for you. - Absolute and relative URIs differ only by the scheme component: if it's
Nothing, then the URI is relative, otherwise it's absolute. - A Megaparsec parser that can be used as a standalone smart constructor for
the
URIdata type (seemkURI) as well as seamlessly integrated into a bigger Megaparsec parser that consumes a strictText(seeparser) or strictByteString(seeparserBs). - The parser performs some normalization, for example it collapses
consecutive slashes. Some smart constructors such as
mkSchemeandmkHostalso perform normalization. So in a sense URIs are also “normalized by construction” to some extent. - Fast rendering to strict
TextandByteStringas well as to their respectiveBuildertypes and toString/ShowS. - Extensive set of lensy helpers for easier manipulation of the nested data
types (see
Text.URI.Lens). - Quasi-quoters for compile-time construction of the
URIdata type and refined text types (seeText.URI.QQ).
The modern-uri package serves three main purposes:
- Construction of the
URIdata type. - Inspection and manipulation of the
URIdata type (in the sense of changing its parts). - Rendering of
URIs.
Let's walk through every operation quickly.
There are four ways to create a URI value. First off, one could assemble
it manually like so:
λ> :set -XOverloadedStrings
λ> import qualified Text.URI as URI
λ> scheme <- URI.mkScheme "https"
λ> scheme
"https"
λ> host <- URI.mkHost "markkarpov.com"
λ> host
"markkarpov.com"
λ> let uri = URI.URI (Just scheme) (Right (URI.Authority Nothing host Nothing)) Nothing [] Nothing
λ> uri
URI
{ uriScheme = Just "https",
uriAuthority =
Right
( Authority
{ authUserInfo = Nothing,
authHost = "markkarpov.com",
authPort = Nothing
}
),
uriPath = Nothing,
uriQuery = [],
uriFragment = Nothing
}In this library we use quite a few refined text values. They only can be
constructed by using smart constructors like mkScheme :: MonadThrow m => Text -> m (RText 'Scheme). For example, if argument to mkScheme is not a
valid scheme, an exception will be thrown. Note that monads such as Maybe
are also instances of the MonadThrow type class, and so the smart
constructors can be used in pure environment as well.
There is a smart constructor that can make an entire URI too, it's called
(unsurprisingly) mkURI:
λ> uri <- URI.mkURI "https://markkarpov.com"
λ> uri
URI
{ uriScheme = Just "https",
uriAuthority =
Right
( Authority
{ authUserInfo = Nothing,
authHost = "markkarpov.com",
authPort = Nothing
}
),
uriPath = Nothing,
uriQuery = [],
uriFragment = Nothing
}If the argument of mkURI is not a valid URI, then an exception will be
thrown. The exception will contain full context and the actual parse error.
If some refined text value or URI is known statically at compile time, we
can use Template Haskell, namely the “quasi quotes” feature. To do so import
the Text.URI.QQ module and enable the QuasiQuotes language extension,
like so:
λ> :set -XQuasiQuotes
λ> import qualified Text.URI.QQ as QQ
λ> let uri = [QQ.uri|https://markkarpov.com|]
λ> uri
URI
{ uriScheme = Just "https",
uriAuthority =
Right
( Authority
{ authUserInfo = Nothing,
authHost = "markkarpov.com",
authPort = Nothing
}
),
uriPath = Nothing,
uriQuery = [],
uriFragment = Nothing
}Note how the value returned by the url quasi quote is pure, its
construction cannot fail because when there is an invalid URI inside the
quote it's a compilation error. The Text.URI.QQ module has quasi-quoters
for scheme, host, and other components.
Finally, the package provides two Megaparsec parsers: parser and
parserBs. The first works on strict Text, while the other one works on
strict ByteStrings. You can use the parsers in a bigger Megaparsec parser
to parse URIs.
Although one could use record syntax directly, possibly with language
extensions like RecordWildcards, the best way to inspect and edit parts of
URI is with lenses. The lenses can be found in the Text.URI.Lens module.
If you have never used the
lens library, you could
probably start by reading/watching materials suggested in the library
description on Hackage.
Here are some examples, just to show off what you can do:
λ> import Text.URI.Lens
λ> uri <- URI.mkURI "https://example.com/some/path?foo=bar&baz=quux&foo=foo"
λ> uri ^. uriScheme
Just "https"
λ> uri ^? uriAuthority . _Right . authHost
Just "example.com"
λ> uri ^. isPathAbsolute
True
λ> uri ^. uriPath
["some","path"]
λ> k <- URI.mkQueryKey "foo"
λ> uri ^.. uriQuery . queryParam k
["bar","foo"]
-- etc.Rendering turns a URI into a sequence of bytes or characters. Currently
the following options are available:
renderfor rendering to strictText.render'for rendering to textBuilder. It's possible to turn that into lazyTextby using thetoLazyTextfunction fromData.Text.Lazy.Builder.renderBsfor rendering to strictByteString.renderBs'for rendering to byte stringBuilder. Similarly it's possible to get a lazyByteStringfrom that by using thetoLazyByteStringfunction fromData.ByteString.Builder.renderStrcan be used to render toString. Sometimes it's handy. The render uses difference lists internally so it's not that slow, but in general I'd advise avoidingStrings.renderStr'returnsShowS, which is just a synonym forString -> String—a function that prepends the result of rendering to a givenString. This is useful when theURIyou want to render is a part of a bigger output, just like with the builders mentioned above.
Examples:
λ> uri <- mkURI "https://markkarpov.com/posts.html"
λ> render uri
"https://markkarpov.com/posts.html"
λ> renderBs uri
"https://markkarpov.com/posts.html"
λ> renderStr uri
"https://markkarpov.com/posts.html"
-- etc.Issues, bugs, and questions may be reported in the GitHub issue tracker for this project.
Pull requests are also welcome.
Copyright © 2017–present Mark Karpov
Distributed under BSD 3 clause license.