Technical Documentation: dwyl/learn-json-web-tokens
โน๏ธ Provenance: Hybrid Fusion:
dwyl/learn-json-web-tokens+dwyl/dwyl.github.ioยท CodeWiki Reference ยท Recency: Active (< 180 days)
1. Project Overview & Quickstart (dwyl/learn-json-web-tokens)
Learn how to use *JSON Web Tokens* (JWT) for *Authentication*
Learn how to use JSON Web Token (JWT) to secure your Web and/or Mobile Application!
*Why*?
JSON Web Tokens (JWTs) make it easy to send read-only signed "claims"
between services (both internal and external to your app/site).
Claims are any bits of data that you want someone else to be able to read
and/or verify but not alter.
Note: If that sounds buzz-wordy, don't worry, it will all become clear in the next 5 mins of reading!
What?
"JSON Web Token (JWT) is a compact URL-safe means of
representing claims to be transferred between two parties.
The claims in a JWT are encoded as a JSON object that is digitally
signed using JSON Web Signature (JWS). ~ IETF
In *English*
To identify/authenticate people in your (web/mobile) app,
put a standards-based token in the header or url of the page
(or API endpoint) which proves the user has logged in and is allowed to
access the desired content.
example: https://www.yoursite.com/private-content/?token=eyJ0eXAiOiJKV1Qi.eyJrZXkiOi.eUiabuiKv
Note: if this does not look "secure" to you,
scroll down to the "security" section.
What does a JWT *Look* Like?
Tokens are a string of "url safe" characters which encode information.
Tokens have three components (separated by periods)
(shown here on multiple lines for readability but used as a single string of text)
eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9 // header
.eyJrZXkiOiJ2YWwiLCJpYXQiOjE0MjI2MDU0NDV9 // payload
.eUiabuiKv-8PYk2AkGY4Fb5KMZeorYBLw261JPQD5lM // signature1. Header
The first part of a JWT is an encoded string representation
of a simple JavaScript object which describes the token along with the hashing algorithm used.
2. Payload
The second part of the JWT forms the core of the token.
Payload length is proportional to the amount of data you store in the JWT.
General rule of thumb is: store the bare minimum in the JWT.
3. Signature
The third, and final, part of the JWT is a signature generated
based on the header (part one) and the body (part two) and will be used
to verify that the JWT is valid.
What are "Claims"?
Claims are the predefined keys and their values:
- iss: issuer of the token
- exp: the expiration timestamp (reject tokens which have expired). Note: as defined in the spec, this must be in seconds.
- iat: The time the JWT was issued. Can be used to determine the age of the JWT
- nbf: "not before" is a future time when the token will become active.
- jti: unique identifier for the JWT. Used to prevent the JWT from being re-used or replayed.
- sub: subject of the token (rarely used)
- aud: audience of the token (also rarely used)
See: https://tools.ietf.org/html/rfc7519#section-4.1
Example [](https://github.com/dwyl/learn-json-web-tokens/issues)
Lets get stuck in with a simple example.
(the full source is in the /example directory)
TRY it: https://jwt.herokuapp.com/
To play around with the example you can open it in Gitpod (requires OAuth with GitHub).
Server
Using the core node.js http server we create 4 endpoints in /example/server.js:
- /home : home page (not essential but its where our login form is.)
- /auth : authenticate the visitor (returns error + login form if failed)
- /private : our restricted content - login required (valid session token) to see this page
- /logout : invalidates the token and logs out the user (prevent from re-using old token)
We have deliberately made server.js as simple as possible for:
- Readability
- Maintainability
- Testability (all helper/handler methods are tested separately)
note: if you can make it simpler, please submit an issue to discuss!
Helper Methods
All the helper methods are kept in /example/lib/helpers.js
The two most interesting/relevant methods are (simplified versions shown here):
// generate the JWT
function generateToken(req){
return jwt.sign({
auth: 'magic',
agent: req.headers['user-agent'],
exp: Math.floor(new Date().getTime()/1000) + 7*24*60*60; // Note: in seconds!
}, secret); // secret is defined in the environment variable JWT_SECRET
}Which generates our JWT token when the user authenticates (this is then sent back to the client in the Authorization header for use in subsequent requests),
and
// validate the token supplied in request header
function validate(req, res) {
var token = req.headers.authorization;
try {
var decoded = jwt.verify(token, secret);
} catch (e) {
return authFail(res);
}
if(!decoded || decoded.auth !== 'magic') {
return authFail(res);
} else {
return privado(res, token);
}
}Which checks the JWT supplied by the client is valid,
shows private ("privado") content to the requestor if valid
and renders the authFail error page if its not.
Note: Yes, both these methods are synchronous.
But, given that neither of these methods require any I/O or Network requests,
its pretty safe to compute them synchronously.
Tip: If you're looking for a Full Featured JWT Auth Hapi.js plugin (which does the verification/validation asynchronously) for your Hapi.js-based app please check out: https://github.com/dwyl/hapi-auth-jwt2
Tests
You may have noticed the [![Build Status][travis-image]][travis-url] badge at the start of this tutorial.
This is a sign the author(s) are not just cobbling code together.
The tests for both the server routes and helper functions are in: /example/test
- /example/test/functional.js - exercises all the helper methods we created in /example/lib/helpers.js
- /example/test/integration.js - simulates the requests a user would send to the server and tests the responses.
Please read through the tests and tell us if anything is unclear!
Note: We wrote a basic "mock" of the http req/res objects see: /example/test/mock.js
Confused/curious about Mocking? Read When to Mock (by "Uncle Bob")
Frequently Asked Questions (*FAQ*)
Got a Question? Ask! >> https://github.com/dwyl/learn-json-web-tokens/issues
Q: If I put the JWT in the *URL* or *Header* is it *secure*?
Good question! The quick answer is: No.
Unless you are using SSL/TLS (https in your url) to encrypt the connection,
sending the Token in-the-clear
is always going to be insecure (the token can be intercepted and re-used by a bad person...).
A naive "mitigation" is to add verifiable "claims" to the token
such as checking that the request came from the same browser (user-agent),
IP address or more advanced
"browser fingerprints"
... https://programmers.stackexchange.com/a/122385
The solution is to either:
- use one-time-use (single use) tokens (which expire after the link has been clicked) or
- Don't use url-tokens where high degree of security is required.
(e.g: don't send someone a link which allows them to perform a transaction)
Use-cases for a JWT token in a url are:
- account verification - when you email a person a link after they register on your site.
https://yoursite.co/account/verify?token=jwt.goes.here - password re-set - ensures that the person re-setting the password has access to the email belonging to the account.
https://yoursite.co/account/reset-password?token=jwt.goes.here
Both of these are good candidates for single-use tokens (which expire after they have been clicked).
Q: How do we *Invalidate* sessions?
The person using your app has their device (phone/tablet/laptop)
stolen. How do you invalidate the token they were using?
The idea behind JWT is that the tokens are stateless
they can be computed by any node in a cluster and verified
without a (slow) request to a database.
Store the Token in a Database?
LevelDB
If your app is small or you don't want to have to run a Redis server,
you can get most of the benefits of Redis by using LevelDB: http://leveldb.org/
We can either store the valid Tokens in the DB or
we can store the invalid tokens.
Both of these require a round-trip to the DB to check if valid/invalid.
So we prefer to store all tokens and update the
valid property of the token from true to false.
Example record stored in LevelDB
"GUID" : {
"auth" : "true",
"created" : "timestamp",
"uid" : "1234"
}We would lookup this record by its GUID:
var db = require('level');
db.get(GUID, function(err, record){
// pseudo-code
if(record.auth){
// display private content
} else {
// show error message
}
});see: example/lib/helpers.js validate method for detail.
Redis
Redis is the scalable way of storing your tokens.
If you are totally new to Redis read:
- Intro: https://redis.io/topics/introduction
- Redis in 30 mins:
https://openmymind.net/2011/11/8/Redis-Zero-To-Master-In-30-Minutes-Part-1/ - What is Redis? https://www.slideshare.net/dvirsky/introduction-to-redis
Redis Scales (provided you have the RAM):
https://stackoverflow.com/questions/10478794/more-than-4-billion-key-value-pairs-in-redis
Get Started with Redis today! https://github.com/dwyl/learn-redis
Memcache?
Quick answer: use Redis:
https://stackoverflow.com/questions/10558465/memcache-vs-redis
Q: Returning Visitor (*no State Preservation between sessions*)
Cookies are stored on the client and are sent by the browser to the server on every request. If the person closes their browser, cookies are preserved, so they can continue where they left off without having to log-in again. However, cookies will be sent on all requests that match the path and issuing domain, including those for images and css, where it isn't needed.
localStorage provides a better mechanism for storing tokens during and between browser sessions.
Browser-based Applications
There are two options for storing your JWTs:
- Use localStorage to store your JWTs on the client side (means you need to remember to send the JWT in your
authorizationheader for subsequent http/ajax requests) - Store your JWT in a cookie (set and forget)
We obviously prefer the cookie-less approach.
But if done right, cookies still have their place in modern web apps!
(see the Auth0 article on "10 things you should know" in the further reading below)
Useful Links
- Good history & overview of Localstorage:
http://diveintohtml5.info/storage.html - MDN Window.localStorage:
https://developer.mozilla.org/en-US/docs/Web/API/Window.localStorage - Brief description + basic examples:
https://www.html5rocks.com/en/features/storage - Will it work for my visitors?
https://caniuse.com/#search=localstorage
(Quick answer: Yes! IE 8 & above, Android 4.0+, IOS 7.1+, Chrome & Firefox )
Programmatic (API) Access
Other services accessing your API will have to store the token in a
retrieval system (e.g: Redis or SQLite for mobile apps) and send the token back on each request.
How to generate secret key?
"Apologies if this is mentioned elsewhere. The private key used for signing the tokens, is this the same as a private key generated using ssh-keygen?" ~ Originally asked by @skota see: dwyl/hapi-auth-jwt2/issues/48
Since JSON Web Tokens (JWT) do not have to be signed using asymmetric encryption you do not have to generate your secret key using ssh-keygen. You can just as easily use a strong password e.g: https://www.grc.com/passwords.htm provided it's long and random. The chance of collision (and thus someone being able to modify the payload, adding or modifying claims, and create a valid signature) is pretty low. And if you join two of those Strong Passwords (strings) together, you'll have a 128bit ASCII String. So the chances of collision are less than the number of atoms in the universe.
To quickly and easily create a secret key using Node's crypto library, run this command.
node -e "console.log(require('crypto').randomBytes(32).toString('hex'));"In other words, you can use an RSA key, but you don't have to.
The main thing you need to remember is: don't share the key with people who are not in your core ("DevOps Team") or accidentally publish it by committing it to GitHub!
Which Node.js Module?
A search for "JSON Web Token" on NPM:
https://www.npmjs.com/search?q=json+web+token yields many results!
Building a Web App with Hapi.js?
In our efforts to simplify using JWTs in Hapi.js apps,
we wrote this module: https://github.com/dwyl/hapi-auth-jwt2
General Use in *Other* Node.js Projects
We highly recommend using the jsonwebtoken module
made by our friends @auth0
(the identity/authentication experts):
- https://github.com/auth0/node-jsonwebtoken
Which in turn uses:
https://github.com/brianloveswords/node-jws
[![NPM][jsonwebtoken-icon] ][jsonwebtoken-url]
Another great option is: https://github.com/joaquimserafim/json-web-token
by our friend @joaquimserafim
Essential Reading (_Background_)
- Official Specification (RFC 7519):
https://tools.ietf.org/html/rfc7519 - Great overview from Atlassian:
https://developer.atlassian.com/cloud/jira/platform/understanding-jwt/ - Good intro (ruby-specific examples):
http://www.intridea.com/blog/2013/11/7/json-web-token-the-useful-little-standard-you-haven-t-heard-about
- Friendlier introduction: https://jwt.io/
- Getting to know JWT:
https://scotch.io/tutorials/the-anatomy-of-a-json-web-token
- Discussion: https://ask.auth0.com/c/jwt
- How to do stateless authentication (session-less & cookie-less):
https://stackoverflow.com/questions/20588467/how-to-do-stateless-session-less-cookie-less-authentication
Further Reading (_Recommended_) [](https://github.com/dwyl/learn-json-web-tokens/issues)
- JWT with Passport.js:
https://stackoverflow.com/questions/20228572/passport-local-with-node-jwt-simple - JWT Tokens as API Keys:
https://auth0.com/blog/2014/12/02/using-json-web-tokens-as-api-keys/ - 10 Things you should know about Tokens and Cookies:
https://auth0.com/blog/2014/01/27/ten-things-you-should-know-about-tokens-and-cookies/#xss-xsrf - Information Security discussion:
https://security.stackexchange.com/questions/51294/json-web-tokens-jwt-as-user-identification-and-authentication-tokens - Using JWT with node.js (express + backbone):
https://www.sitepoint.com/using-json-web-tokens-node-js/ - Token-based Authentication with Socket.IO
https://auth0.com/blog/2014/01/15/auth-with-socket-io/ - JWT Auth discussion on Hacker News:
https://news.ycombinator.com/item?id=7084435 - The Spec but nicer:
https://self-issued.info/docs/draft-ietf-oauth-json-web-token.html - Extended (Wiki) article on Claims-based authentication:
https://en.wikipedia.org/wiki/Claims-based_identity - Securing Requests with JWT:
https://web.archive.org/web/20240918103054/https://www.websec.io/2014/08/04/Securing-Requests-with-JWT.html - Avoid Database in authenticating user for each request (stateless):
https://security.stackexchange.com/questions/49145/avoid-hitting-db-to-authenticate-a-user-on-every-request-in-stateless-web-app-ar - The Twelve-Factor App: https://12factor.net/ + https://12factor.net/processes
- Auth in Hapi with JWT: https://medium.com/@thedon/auth-in-hapi-with-jwt-780ce4d072c7#.clgj5lknq
- Token based authentication in Node.js with Passport, JWT and bcrypt: https://jonathas.com/token-based-authentication-in-nodejs-with-passport-jwt-and-bcrypt/
- JWT Signing Algorithms: https://www.loginradius.com/blog/async/jwt-signing-algorithms/
*Thanks* for Learning with Us!
If you found this quick guide useful, please star it on GitHub!
and re-tweet to share it with others: https://twitter.com/olizilla/status/626487231860080640
2. Official Technical Reference & Guides (dwyl/dwyl.github.io)
File: README.md
*Welcome* to the dwyl website! [](https://github.com/dwyl/dwyl-site/actions)
It's as ever a work in progress, so please don't hesitate to
share your ideas
on how to make it better!
The current site was designed by
@harrygfox
and built by
@Cleop,
@ZooeyMiller
&
@finnhodgkin.
You can see the original Invision slides here :sparkles:
How?
Technology
Hosted on GitHub Pages with Cloudflare for SSL
Functional CSS with Tachyons :heart:
Hop over to learn-tachyons to find out
how we use functional css to power our website.
Javascript
We've kept JS to a minimum on the site, using it only when required to
enhance UX, and taking every care to ensure that it
gracefully degrades
for users with JavaScript disabled.
Viewing locally
With Live Reload
To view the site locally, execute the following two commands:
git clone [email protected]:dwyl/dwyl-site.git & cd dwyl-site
python3 -m http.serverThen open your web browser to: http://localhost:8000
Accessibility
The site meets WCAG 2.0 Level A for accessibility. Please
raise an issue if you notice any
accessibility problems!
Cloudflare setup
We're using the Cloudflare free tier to serve dwyl.com over https.
To add your own account head over to cloudflare.com
and sign up for an account. Add your custom domain and wait while Cloudflare
scans your domain setup. Once that's done you'll need to add the Cloudflare
nameservers to your own DNS.
Changes involving nameservers can sometime take time, so if something isn't
working straight away just be patient and come back to it later.
Adding SSL
GitHub page don't provide https access to custom domains, so we use Cloudflare
to reroute requests through their secure server. Hop over to the Crypto tab of
the Cloudflare control panel and change SSL to flexible:
To force the site to always redirect http requests to https add a page rule:
Adding subdomains
dwyl.com has three subdomains all set up in a slightly different way.
Google form redirect - one subdomain on dwyl.com just redirects to a Google
form. First add a general CNAME record:
Then add a page rule to redirect to the specific URL:
A name subdomain - hits.dwyl.com is added via a standard A
name record:
GitHub pages subdomain - tachyons-bootstrap.dwyl.com
is hosted via GitHub pages. There's a slightly more complicated setup process
for subdomains hosted in this way which is explained well in this guide.
How do I add myself to the team page?
You'll need to copy and past this block of code, replace your details where
noted, and paste it at the bottom of the team section (just before the closing<section> tag, with a comment ``) in team.html.
<label for="YOUR-NAME" class="pointer">
YOUR-NAME
YOUR-JOB-ROLE
</label>
<a href="https://github.com/YOUR-GITHUB-HANDLE" class="mr3 link dwyl-bg-yellow br-100 center w2 h2 dib">
YOUR-NAME's GitHub
</a>
<a href="https://twitter.com/YOUR-TWITTER-HANDLE" class="ml3 link dwyl-bg-yellow br-100 center w2 h2 dib">
YOUR-NAME's Twitter
</a>
YOUR-SELF-DESCRIPTION-(50-100 words)File: _home/README.md
Huh...?
This directory contains the script that generates the home.html file
in the root of the repository.
To run the script you will need to be connected to the internet
as it will "scrape" the README.md of: https://github.com/dwyl/home
node _home/compile.jsYou should see:
done.(if you see anything else, please try to debug it locally,
and if you're still scratching your head, open an issue on GitHub!)
--- METRICS ---
- Files Extracted: 3
- Estimated Token Budget: ~5703 tokens
- Recency Window: Active (< 180 days)
- Canonical Reference: https://codewiki.google/github.com/dwyl/learn-json-web-tokens