nRF Connect SDK code base

The source code, libraries, and tools that compose the nRF Connect SDK are entirely hosted in a set of Git repositories, which are managed using Zephyr’s West tool. All nRF Connect SDK repositories are publicly hosted on the nrfconnect GitHub organization, and accessible to both individual users and companies.

Some notable repositories include:

  • sdk-nrf repository - Contains applications, samples, libraries, and drivers that are specifically targeted at Nordic Semiconductor devices.

  • sdk-nrfxlib repository - Contains closed-source libraries and modules in binary format. See the nrfxlib documentation.

  • sdk-zephyr repository - Contains a fork of the Zephyr project, which provides samples, libraries, and drivers for a wide variety of devices, including Nordic Semiconductor devices. See the documentation in Nordic Semiconductor’s Zephyr fork.

    Note

    The sdk-zephyr repository is a soft fork that Nordic Semiconductor maintains. It is not the same as Zephyr SDK, which is a set of installation tools that is part of the toolchain package used while installing the |NCS|.

  • sdk-mcuboot repository - Contains a fork of the MCUboot project, which provides a secure bootloader application. You can find the fork in bootloader/mcuboot after obtaining the nRF Connect SDK source code. See the documentation in Nordic Semiconductor’s MCUboot fork.

All repositories with the prefix sdk contain the nRF Connect SDK firmware and code. See Repository types for more information.

Every nRF Connect SDK release consists of a combination of all included repositories at different revisions. See the nRF Connect SDK repository revisions section for a comprehensive list of repositories and their current revisions. The revision of each of those repositories is determined by the current revision of the main (manifest) repository sdk-nrf.

Git and west

Basic familiarity with Git and west is required to understand the architecture of the repository set and to work with the nRF Connect SDK.

Git

Git is a free and open source distributed version control system that allows managing the changes in the code or other collections of information (set of files) over time.

Git offers a lot of flexibility in how users manage changes, and repositories are easily duplicated. In the nRF Connect SDK, forking is the agreed-upon Git workflow. To contribute, the official public repository in GitHub is forked.

A fork can be hosted on any server, including a public Git hosting site like GitHub. It is, however, important to differentiate between the generic concept of a fork and GitHub’s concept of a GitHub fork. When you create a GitHub fork, GitHub copies the original repository and tags the downstream repository (the fork) with a flag that allows users to send pull requests from the fork to its upstream repository. GitHub also supports creating forks without linking them to the upstream repository. See the GitHub documentation for information about how to do this.

West

The Zephyr project includes a tool called west. The nRF Connect SDK uses west to manage the combination of multiple Git repositories and versions.

Some of west’s features are similar to those provided by submodules of Git and Google’s Repo tool. But west also includes custom features required by the Zephyr project that were not sufficiently supported by the existing tools.

West’s workspace contains exactly one manifest repository, which is a main Git repository containing a west manifest file. Additional Git repositories in the workspace managed by west are called projects. The manifest repository controls which commits to use from the different projects through the manifest file. In the nRF Connect SDK, the main repository sdk-nrf contains a west manifest file west.yml, that determines the revision of all other repositories. This means that sdk-nrf acts as the manifest repository, while the other repositories are projects.

When developing in the nRF Connect SDK, your application will use libraries and features from folders that are cloned from different repositories or projects. The west tool keeps control of which commits to use from the different projects. It also makes it fairly simple to add and remove modules.

Repository types

There are two main types of Git repositories in the nRF Connect SDK repository set:

nRF repositories

These repositories have the following characteristics:

  • Created, developed, and maintained by Nordic.

  • Usually licensed for use on Nordic products only.

nRF repositories are stand-alone and have no upstreams, since they are unique to the nRF Connect SDK. Following are some examples of this type of repositories:

  • sdk-nrf: The main repository for Nordic-developed software.

  • sdk-nrfxlib: A repository containing linkable libraries developed by Nordic.

OSS repositories

These repositories have the following characteristics:

  • Created and maintained by Nordic.

  • Soft forks of open-source projects.

  • Typically contain a small set of changes that are specific to nRF Connect SDK.

  • Updated (“upmerged”) regularly with the latest changes from the open source project.

OSS repositories are typically soft forks of an upstream open source project, which Nordic maintains in order to keep a small set of changes that do not belong, or have not been merged, to the upstream official open-source repository. For example:

See also OSS repositories downstream project history and Userdata associated with OSS repositories for more information about how these repositories are maintained.

From Zephyr perspective, all these repositories are considered external modules.

Repository structure

The nRF Connect SDK uses west to manage the combination of repositories and versions.

A manifest repository, sdk-nrf, contains a file in its root folder, west.yml, which lists all other repositories (west projects) included in the nRF Connect SDK. The nRF Connect SDK repository structure has a star topology, with the sdk-nrf repository being the center of the star and all other repositories being west projects that are managed by west.yml. This is equivalent to topology T2 in the west documentation.

A graphical depiction of the |NCS| repository structure

The nRF Connect SDK repository structure

The figure above depicts the nRF Connect SDK repository structure. A central concept with this repository structure is that each revision (in Git terms) of the sdk-nrf repository completely determines the revisions of all other repositories (that is, the west projects). This means that the linear Git history of this manifest repository also determines the history of the repository set in its entirety, thanks to the west.yml west manifest file being part of the manifest repository.

West reads the contents of the manifest file to find out which revisions of the project repositories are to be checked out every time west update is run. In this way, you can decide to work with a specific nRF Connect SDK release either by initializing a new west installation at a particular tag or by checking out the corresponding tag for a release in an existing installation and then updating your project repositories to the corresponding state with west update. Alternatively, you can work with the latest state of development by using the main branch of the sdk-nrf repository, updating it with Git regularly and using west update to update the project repositories every time the manifest repository changes. More information about manifests can be found in the west manifest section of the Zephyr documentation.

Versions and revisions

The nRF Connect SDK version numbers are assigned based on very specific criteria. They follow the MAJOR.MINOR.PATCH pattern (also further called as X.Y.Z), with possible additional postfixes depending on the release. All releases are accompanied by their respective Release notes.

Release type

Release criteria

Comments

MAJOR

Introduces a large number of substantial changes across the board

Major version number is increased rarely. Major releases are always accompanied by a migration guide.

MINOR

Introduces one or more new functionalities.

Version number is increased every time a minor release is cut. Minor releases are the default types of an nRF Connect SDK release and usually are accompanied by a migration guide. The new functionalities may break existing APIs.

PATCH

Introduces bugfixes or minor changes to the existing functionalities.

Patch releases only address functional issues and do not introduce new functionalities. Patch releases do not come with migration guide.

MAJOR.MINOR.99

The 99 added at the end of the version number indicates that the version string is a point in between two releases. Such version does not belong to a release and corresponds to the current state of development.

The number can be used between minor, major, or patch releases.

MAJOR.MINOR.PATCH-devN

Development tag, marked through a postfix added to the end of the version. Indicates a snapshot of the development state that is created to highlight the introduction of a new piece of functionality.

Not part of the regular release cycle. The -devN version might not be subjected to the same amount of testing as a regular nRF Connect SDK release.

There are two fundamental revisions that are relevant to most nRF Connect SDK users:

  • The main branch of the sdk-nrf repository

  • Any Git tag (that is, release, release candidate or development tag) of the sdk-nrf repository

The main branch of the sdk-nrf repository always contains the latest development state of the nRF Connect SDK (MAJOR.MINOR.99). Since all development is done openly, you can use it if you are not particularly concerned about the stability and want to track the latest changes that are being merged continuously into different repositories.

The nRF Connect SDK revision entry changes every time a Git commit is merged into the sdk-nrf repository. The revision of the SDK is considered to be equivalent to the repository revision of sdk-nrf, because it is the manifest repository. This means that, by virtue of containing the west manifest file, its revision uniquely identifies the revisions of all other repositories included in the SDK.

Git tags

The Git tags correspond to official releases tested and signed by the Nordic engineers. The format for nRF repositories is as follows:

vX.Y.Z(-rcN)

Where X, Y and Z are the MAJOR, MINOR and PATCH version respectively. A release candidate postfix -rcN can be optionally attached if the tag identifies a candidate instead of the actual release.

The Git tags are composed as follows:

vX.Y.Z(-rcN|-devN)

Tags without a suffix correspond to official releases tested and signed by Nordic Semiconductor engineers. A release candidate suffix -rcN is attached if the tag identifies a candidate instead of the actual release.

In between releases, there might be development tags. These are identified by a -devN suffix included after the nRF Connect SDK version, for example v1.9.99-dev1 for the main branch or v1.9.2-dev1 for the release branch. Such versions indicate a snapshot of the development state that is created to highlight the introduction of a new piece of functionality. Unlike an nRF Connect SDK release, a -devN version may or may not have received the same amount of testing.

In the case of OSS repositories, the git tag format reuses the upstream project’s version along with some nRF Connect SDK specific postfixes:

vX.Y.Z-ncsN(-rcM)

In this format, X, Y and Z are the MAJOR, MINOR and PATCH versions of the upstream project, and -ncsN is used to identify the number of nRF Connect SDK releases based on that particular version.

OSS repositories downstream project history

As described in Repository types, the nRF Connect SDK contains OSS repositories, which are based on third-party, open-source Git repositories and may contain additional patches not present upstream. Examples include sdk-zephyr and sdk-mcuboot, which have upstream open-source projects used as a basis for downstream repositories distributed with the nRF Connect SDK. This section describes how the history of these OSS repositories is maintained, and how they are synchronized with their upstreams.

The short logs for these downstream patches contain [nrf xyz] at the beginning, for different xyz strings. This makes their different purposes downstream clearer, and makes them easier to search for and see in git log. The current values of [nrf xyz] are:

  • [nrf mergeup]- Periodic merges of the upstream tree

  • [nrf fromlist]- Patches which have upstream pull requests, including any later revisions

  • [nrf noup]- Patches which are specific to the nRF Connect SDK

  • [nrf fromtree]- Patches which have been cherry-picked from an upstream tree

Note

The downstream project history is periodically rewritten. This is important to prevent the number of downstream patches included in a specific nRF Connect SDK release from increasing forever. A repository’s history is typically only rewritten once for every nRF Connect SDK release.

To make incorporating new history into your own forks easier, a new point in the downstream nRF Connect SDK history is always created which has an empty git diff with the previous version. The empty diff means you can always use:

  • git merge to get the rewritten history merged into your own fork without errors

  • git rebase --onto or git cherry-pick to reapply any of your own patches cleanly before and after the history rewrite

  • git cherry to list any additional patches you may have applied to these projects to rewrite history as needed

Additionally, both the old and new histories are committed sequentially into the revision fields for these projects in the nrf/west.yml west manifest file. This means you can always combine git bisect in the nrf repository with west update at each bisection point to diagnose regressions and the rest.

Userdata associated with OSS repositories

The west manifest file nrf/west.yml contains userdata values for some OSS repository projects.

This section documents these values and their purpose. However, they are mainly meant for internal use and are safe to ignore.

See Repository user data for general information about the west userdata feature.

In the nRF Connect SDK, each userdata value has this format:

ncs:
  upstream-url: https://...
  upstream-sha: GIT_SHA
  compare-by-default: <true|false>

These fields are used to track some extra OSS repository metadata. The metadata is present for projects which are not included in the nRF Connect SDK directly from the Zephyr project’s manifest in zephyr/west.yml. Repository maintainers use this metadata while synchronizing the nRF Connect SDK fork of each repository with its upstream repository.

The meaning of each userdata field is:

  • upstream-url - Git URL that the project is synchronized against

  • upstream-sha - Most recent Git SHA in the upstream-url repository which is included in the nRF Connect SDK fork of the repository

  • compare-by-default - If true, internal nRF Connect SDK synchronization tooling will include information related to this repository by default