nRF Connect SDK code base
The source code, libraries, and tools that compose the nRF Connect SDK are entirely hosted in a set of Git repositories, which are managed using Zephyr’s West tool. All nRF Connect SDK repositories are publicly hosted on the nrfconnect GitHub organization, and accessible to both individual users and companies.
Some notable repositories include:
sdk-nrf repository - Contains applications, samples, libraries, and drivers that are specifically targeted at Nordic Semiconductor devices.
sdk-nrfxlib repository - Contains closed-source libraries and modules in binary format. See the nrfxlib documentation.
sdk-zephyr repository - Contains a fork of the Zephyr project, which provides samples, libraries, and drivers for a wide variety of devices, including Nordic Semiconductor devices. See the documentation in Nordic Semiconductor’s Zephyr fork.
Note
The sdk-zephyr repository is a soft fork that Nordic Semiconductor maintains. It is not the same as Zephyr SDK, which is a set of installation tools used while installing the nRF Connect SDK.
sdk-mcuboot repository - Contains a fork of the MCUboot project, which provides a secure bootloader application. You can find the fork in
bootloader/mcuboot
after obtaining the nRF Connect SDK source code. See the documentation in Nordic Semiconductor’s MCUboot fork.
All repositories with the prefix sdk
contain the nRF Connect SDK firmware and code.
See Repository types for more information.
Every nRF Connect SDK release consists of a combination of all included repositories at different revisions.
See the nRF Connect SDK repository revisions section for a comprehensive list of repositories and their current revisions.
The revision of each of those repositories is determined by the current revision of the main (manifest) repository sdk-nrf
.
Git and west
Basic familiarity with Git and west is required to understand the architecture of the repository set and to work with the nRF Connect SDK.
Git
Git is a free and open source distributed version control system that allows managing the changes in the code or other collections of information (set of files) over time.
Git offers a lot of flexibility in how users manage changes, and repositories are easily duplicated. In the nRF Connect SDK, forking is the agreed-upon Git workflow. To contribute, the official public repository in GitHub is forked.
A fork can be hosted on any server, including a public Git hosting site like GitHub. It is, however, important to differentiate between the generic concept of a fork and GitHub’s concept of a GitHub fork. When you create a GitHub fork, GitHub copies the original repository and tags the downstream repository (the fork) with a flag that allows users to send pull requests from the fork to its upstream repository. GitHub also supports creating forks without linking them to the upstream repository. See the GitHub documentation for information about how to do this.
West
The Zephyr project includes a tool called west. The nRF Connect SDK uses west to manage the combination of multiple Git repositories and versions.
Some of west’s features are similar to those provided by submodules of Git and Google’s Repo tool. But west also includes custom features required by the Zephyr project that were not sufficiently supported by the existing tools.
West’s workspace contains exactly one manifest repository, which is a main Git repository containing a west manifest file.
Additional Git repositories in the workspace managed by west are called projects.
The manifest repository controls which commits to use from the different projects through the manifest file.
In the nRF Connect SDK, the main repository sdk-nrf contains a west manifest file west.yml
, that determines the revision of all other repositories.
This means that sdk-nrf acts as the manifest repository, while the other repositories are projects.
When developing in the nRF Connect SDK, your application will use libraries and features from folders that are cloned from different repositories or projects. The west tool keeps control of which commits to use from the different projects. It also makes it fairly simple to add and remove modules.
Repository types
There are two main types of Git repositories in the nRF Connect SDK repository set:
- nRF repositories
These repositories have the following characteristics:
Created, developed, and maintained by Nordic.
Usually licensed for use on Nordic products only.
nRF repositories are stand-alone and have no upstreams, since they are unique to the nRF Connect SDK. Some examples of repositories of this type are:
sdk-nrf: The main repository for Nordic-developed software.
sdk-nrfxlib: A repository containing linkable libraries developed by Nordic.
- OSS repositories
These repositories have the following characteristics:
Created and maintained by Nordic.
Soft forks of open-source projects.
Typically contain a small set of changes that are specific to nRF Connect SDK.
Updated (“upmerged”) regularly with the latest changes from the open source project.
OSS repositories are typically soft forks of an upstream open source project, which Nordic maintains in order to keep a small set of changes that do not belong, or have not been merged, to the upstream official open-source repository. For example:
sdk-zephyr is a soft fork (and therefore a downstream) of the upstream official Zephyr repository.
sdk-mcuboot is a soft fork (and therefore a downstream) of the upstream official MCUboot repository.
See also OSS repositories downstream project history and Userdata associated with OSS repositories for more information about how these repositories are maintained.
From Zephyr perspective, all these repositories are considered external modules.
Repository structure
The nRF Connect SDK uses west to manage the combination of repositories and versions.
A manifest repository, sdk-nrf, contains a file in its root folder, west.yml
, which lists all other repositories (west projects) included in the nRF Connect SDK.
The nRF Connect SDK repository structure has a star topology, with the sdk-nrf repository being the center of the star and all other repositories being west projects that are managed by west.yml
.
This is equivalent to topology T2 in the west documentation.
The figure above depicts the nRF Connect SDK repository structure.
A central concept with this repository structure is that each revision (in Git terms) of the sdk-nrf repository completely determines the revisions of all other
repositories (that is, the west projects).
This means that the linear Git history of this manifest repository also determines the history of the repository set in its entirety, thanks to the west.yml
west manifest file being part of the manifest repository.
West reads the contents of the manifest file to find out which revisions of the project repositories are to be checked out every time west update
is run.
In this way, you can decide to work with a specific nRF Connect SDK release either by initializing a new west installation at a particular tag or by checking out the corresponding tag for a release in an existing installation and then updating your project repositories to the corresponding state with west update
.
Alternatively, you can work with the latest state of development by using the main branch of the sdk-nrf repository, updating it with Git regularly and using west update
to update the project repositories every time the manifest repository changes.
More information about manifests can be found in the west manifest section of the Zephyr documentation.
Versions and revisions
The nRF Connect SDK version numbers are assigned based on very specific criteria.
They follow the MAJOR.MINOR.PATCH
pattern (also further called as X.Y.Z
), with possible additional postfixes depending on the release.
Release type |
Release critera |
Comments |
---|---|---|
|
Introduces a large number of substantial changes across the board |
Major version number is increased rarely and the release is accompanied by a migration guide. |
|
Introduces one or more new functionalities. |
Version number is increased every time a major release is cut. Minor releases are the default types of an nRF Connect SDK release. The new functionalities may break exisiting APIs. |
|
Introduces bugfixes or minor changes to the existing functionalities. |
Patch releases only address functional issues and do not introduce new functionalities. |
|
The |
The number can be used between minor, major, or patch releases. |
|
Development tag, marked through a postfix added to the end of the version. Indicates a snapshot of the development state that is created to highlight the introduction of a new piece of functionality. |
|
There are two fundamental revisions that are relevant to most nRF Connect SDK users:
The
main
branch of the sdk-nrf repositoryAny Git tag (that is, release, release candidate or development tag) of the sdk-nrf repository
The main
branch of the sdk-nrf repository always contains the latest development state of the nRF Connect SDK (MAJOR.MINOR.99
).
Since all development is done openly, you can use it if you are not particularly concerned about the stability and want to track the latest changes that are being merged continuously into different repositories.
The nRF Connect SDK revision entry changes every time a Git commit is merged into the sdk-nrf repository.
The revision of the SDK is considered to be equivalent to the repository revision of sdk-nrf
, because it is the manifest repository.
This means that, by virtue of containing the west manifest file, its revision uniquely identifies the revisions of all other repositories included in the SDK.
OSS repositories downstream project history
As described in Repository types, the nRF Connect SDK contains OSS repositories, which are based on third-party, open-source Git repositories and may contain additional patches not present upstream. Examples include sdk-zephyr and sdk-mcuboot, which have upstream open-source projects used as a basis for downstream repositories distributed with the nRF Connect SDK. This section describes how the history of these OSS repositories is maintained, and how they are synchronized with their upstreams.
The short logs for these downstream patches contain [nrf xyz]
at the beginning, for different xyz
strings.
This makes their different purposes downstream clearer, and makes them easier to search for and see in git log
.
The current values of [nrf xyz]
are:
[nrf mergeup]
- Periodic merges of the upstream tree[nrf fromlist]
- Patches which have upstream pull requests, including any later revisions[nrf noup]
- Patches which are specific to the nRF Connect SDK[nrf fromtree]
- Patches which have been cherry-picked from an upstream tree
Note
The downstream project history is periodically rewritten. This is important to prevent the number of downstream patches included in a specific nRF Connect SDK release from increasing forever. A repository’s history is typically only rewritten once for every nRF Connect SDK release.
To make incorporating new history into your own forks easier, a new point in the downstream nRF Connect SDK history is always created which has an empty git diff
with the previous version.
The empty diff means you can always use:
git merge
to get the rewritten history merged into your own fork without errorsgit rebase --onto
orgit cherry-pick
to reapply any of your own patches cleanly before and after the history rewritegit cherry
to list any additional patches you may have applied to these projects to rewrite history as needed
Additionally, both the old and new histories are committed sequentially into the revision
fields for these projects in the nrf/west.yml
west manifest file.
This means you can always combine git bisect
in the nrf
repository with west update
at each bisection point to diagnose regressions and the rest.
Userdata associated with OSS repositories
The west manifest file nrf/west.yml
contains userdata
values for some OSS repository projects.
This section documents these values and their purpose. However, they are mainly meant for internal use and are safe to ignore.
See Repository user data for general information about the west userdata
feature.
In the nRF Connect SDK, each userdata
value has this format:
ncs:
upstream-url: https://...
upstream-sha: GIT_SHA
compare-by-default: <true|false>
These fields are used to track some extra OSS repository metadata.
The metadata is present for projects which are not included in the nRF Connect SDK directly from the Zephyr project’s manifest in zephyr/west.yml
.
Repository maintainers use this metadata while synchronizing the nRF Connect SDK fork of each repository with its upstream repository.
The meaning of each userdata
field is:
upstream-url
- Git URL that the project is synchronized againstupstream-sha
- Most recent Git SHA in theupstream-url
repository which is included in the nRF Connect SDK fork of the repositorycompare-by-default
- Iftrue
, internal nRF Connect SDK synchronization tooling will include information related to this repository by default