curl/tests/unit
Stefan Eissing 2b3dfb4ad4
lib: make resolving HTTPS DNS records reliable:
- allow to specify when they are wanted on starting a resolve
- match dns cache entries accordingly. An entry which never
  tried to get HTTPS-RRs is no answer for a resolve that wants
  it.
- fix late arrivals of resolve answers to match the "async"
  records that started them - if it still exists.
- provide for multiple "async" resolves in a transfer at the
  same time. We may need to resolve an IP interface while the
  main connection resolve has not finished yet.
- allow lookup of HTTPS-RR information as soon as it is
  available, even if A/AAAA queries are still ongoing.

For this, the "async" infrastructure is changed:

- Defined bits for DNS queries `CURL_DNSQ_A`, `CURL_DNSQ_AAAA`
  and `CURL_DNSQ_HTTPS`. These replace `ip_version` which says
  nothing about HTTPS.
  Use them in dns cache entries for matching.
- enhance the `async->id` to be a unique `uint32_t` for
  resolves inside one multi. This is weak, as the id may
  wrap around. However it is combined with the `mid` of
  the easy handle, making collisions highly unlikely.
  `data->state.async` is only accessed in few places where
  the mid/async-id match is performed.
- vtls: for ECH supporting TLS backends (openssl, rustls, wolfssl),
  retrieve the HTTPS-RR information from the dns connection filter.
  Delay the connect if the HTTPS-RR is needed, but has not
  been resolved yet.

The implementation of all this is complete for the threaded
resolver. c-ares resolver and DoH do not take advantage of
all new async features yet. To be done in separate PRs.

Details:

c-ares: cleanup settings and initialisation. Any ares channel
is only being created on starting a resolve and propagating
operations in setopt.c to the channel are not helpful.

Changed threaded+ares pollset handling so that they do not
overwrite each others `ASYNC_NAME` timeouts.

Add trace name 'threads' for tracing thread queue and
pool used by threaded resolver.

Closes #21175
2026-04-01 15:36:31 +02:00
..
.gitignore tests: always make bundles, adapt build and tests 2025-06-14 21:08:23 +02:00
CMakeLists.txt cmake: rename testbins target to tt, restore internal option 2026-03-01 00:24:47 +01:00
Makefile.am autotools: limit checksrc target to ignore non-repo test sources 2026-03-12 01:45:24 +01:00
Makefile.inc HSTS: cap the list at 1,000 entries 2026-04-01 14:38:41 +02:00
README.md tests/unit/README: describe how to unit test static functions 2026-03-20 07:56:19 +01:00
unit1300.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1302.c build: use more const 2026-02-02 12:32:49 +01:00
unit1303.c timeout handling: auto-detect effective timeout 2026-01-20 16:43:45 +01:00
unit1304.c test1304: drop CURL_UNCONST() 2026-02-02 12:28:13 +01:00
unit1305.c dnscache: own source file, improvements 2026-03-21 12:04:36 +01:00
unit1307.c tests: include headers only when used 2025-12-31 17:00:56 +01:00
unit1309.c clang-tidy: enable readability-math-missing-parentheses, adjust code 2026-02-23 18:57:40 +01:00
unit1323.c tidy-up: one more round of formatting nits 2025-12-04 19:30:59 +01:00
unit1330.c build: stop overriding standard memory allocation functions 2025-11-28 10:44:26 +01:00
unit1395.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1396.c tests: rename CURLMcode variables to mresult 2025-12-17 08:55:12 +01:00
unit1397.c tidy-up: miscellaneous 2025-12-12 04:18:48 +01:00
unit1398.c gcc: guard #pragma diagnostic in core code for <4.6, disable picky warnings 2026-03-18 11:33:37 +01:00
unit1399.c time-keeping: keep timestamp in multi, always update 2025-12-18 22:10:06 +01:00
unit1600.c build: use more const 2026-02-02 12:32:49 +01:00
unit1601.c build: use more const 2026-02-02 12:32:49 +01:00
unit1602.c build: stop overriding standard memory allocation functions 2025-11-28 10:44:26 +01:00
unit1603.c build: use more const 2026-02-02 12:32:49 +01:00
unit1605.c tests: rename CURLMcode variables to mresult 2025-12-17 08:55:12 +01:00
unit1606.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1607.c cmake: add CURL_GCC_ANALYZER option, enable in CI, fix/silence 2026-03-16 11:49:34 +01:00
unit1608.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1609.c cmake: add CURL_GCC_ANALYZER option, enable in CI, fix/silence 2026-03-16 11:49:34 +01:00
unit1610.c build: use more const 2026-02-02 12:32:49 +01:00
unit1611.c build: use more const 2026-02-02 12:32:49 +01:00
unit1612.c build: use more const 2026-02-02 12:32:49 +01:00
unit1614.c tidy-up: one more round of formatting nits 2025-12-04 19:30:59 +01:00
unit1615.c build: use more const 2026-02-02 12:32:49 +01:00
unit1616.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1620.c cf-dns: connection filter for DNS queries 2026-03-30 13:28:38 +02:00
unit1625.c test1625: unit test for Curl_compareheader 2026-03-12 10:30:14 +01:00
unit1626.c test1626: Curl_copy_header_value unit test 2026-03-12 13:59:59 +01:00
unit1627.c rtmp: drop support 2026-03-21 14:56:06 +01:00
unit1636.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1650.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1651.c tests: rename more CURLcode variables to result 2026-01-26 05:46:48 +01:00
unit1652.c gcc: guard #pragma diagnostic in core code for <4.6, disable picky warnings 2026-03-18 11:33:37 +01:00
unit1653.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1654.c unit1654: fix clang-tidy bugprone-redundant-branch-condition 2026-02-20 17:33:35 +01:00
unit1655.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1656.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1657.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1658.c lib: make resolving HTTPS DNS records reliable: 2026-04-01 15:36:31 +02:00
unit1660.c tests: rename more CURLcode variables to result 2026-01-26 05:46:48 +01:00
unit1661.c clang-tidy: drop redundant casts 2026-02-19 15:27:17 +01:00
unit1663.c tests: rename more CURLcode variables to result 2026-01-26 05:46:48 +01:00
unit1664.c tidy-up: miscellaneous 2026-02-25 14:44:56 +01:00
unit1666.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1667.c x509asn1: fixed and adapted for ASN1tostr unit testing 2026-03-20 13:03:40 +01:00
unit1668.c test1668: unit test the FTP 213 time response parser 2026-03-21 23:10:32 +01:00
unit1669.c altsvc: cap the list at 5,000 entries 2026-04-01 12:05:47 +02:00
unit1674.c HSTS: cap the list at 1,000 entries 2026-04-01 14:38:41 +02:00
unit1979.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit1980.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit2600.c cf-dns: connection filter for DNS queries 2026-03-30 13:28:38 +02:00
unit2601.c tests: rename more CURLcode variables to result 2026-01-26 05:46:48 +01:00
unit2602.c tests: rename more CURLcode variables to result 2026-01-26 05:46:48 +01:00
unit2603.c clang-tidy: drop redundant casts 2026-02-19 15:27:17 +01:00
unit2604.c gcc: guard #pragma diagnostic in core code for <4.6, disable picky warnings 2026-03-18 11:33:37 +01:00
unit2605.c tidy-up: miscellaneous 2026-03-09 11:35:19 +01:00
unit3200.c gcc: guard #pragma diagnostic in core code for <4.6, disable picky warnings 2026-03-18 11:33:37 +01:00
unit3205.c unit3205: drop NOLINT 2026-03-05 13:50:56 +01:00
unit3211.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit3212.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit3213.c lib: move all UNITTEST prototypes to C files 2026-03-20 07:47:57 +01:00
unit3214.c mimepost: allocate main struct on-demand 2026-01-12 16:21:02 +01:00
unit3216.c ratelimit: download finetune 2026-01-16 16:42:31 +01:00
unit3219.c protcol.h: fix the CURLPROTO_MASK 2026-03-20 17:24:01 +01:00
unit3300.c lib: add thread pool and queue 2026-03-23 23:03:58 +01:00
unit3301.c lib: add thread pool and queue 2026-03-23 23:03:58 +01:00

Unit tests

The goal is to add tests for all functions in libcurl. If functions are too big and complicated, we should split them into smaller and testable ones.

Build Unit Tests

./configure --enable-debug is required for the unit tests to build. To enable unit tests, there is a separate static libcurl built that is used exclusively for linking unit test programs. Build everything as normal, and then you can run the unit test cases as well.

Run Unit Tests

Unit tests are run as part of the regular test suite. If you have built everything to run unit tests, to can do 'make test' at the root level. Or you can cd tests and make and then invoke individual unit tests with ./runtests.pl NNNN where NNNN is the specific test number.

Debug Unit Tests

If a specific test fails you get told. The test case then has output left in the %LOGDIR subdirectory, but most importantly you can re-run the test again using gdb by doing ./runtests.pl -g NNNN. That is, add a -g to make it start up gdb and run the same case using that.

Write Unit Tests

We put tests that focus on an area or a specific function into a single C source file. The source file should be named unitNNNN.c where NNNN is a previously unused number.

Add your test to tests/unit/Makefile.inc (if it is a unit test). Add your test data filename to tests/data/Makefile.am

You also need a separate file called tests/data/testNNNN (using the same number) that describes your test case. See the test1300 file for inspiration and the tests/FILEFORMAT.md documentation.

For the actual C file, here's a simple example:

    #include "unitcheck.h"

    #include "a libcurl header.h" /* from the lib directory */

    static CURLcode test_unit9998(const char *arg)
    {
      UNITTEST_BEGIN_SIMPLE

      /* here you start doing things and checking that the results are good */

      fail_unless( size == 0 , "initial size should be zero" );
      fail_if( head == NULL , "head should not be initiated to NULL" );

      /* you end the test code like this: */

      UNITTEST_END_SIMPLE
    }

Here's an example using optional initialization and cleanup:

    #include "unitcheck.h"

    #include "a libcurl header.h" /* from the lib directory */

    static CURLcode t9999_setup(void)
    {
      /* whatever you want done first */
      return CURLE_OK;
    }

    static void t9999_stop(void)
    {
      /* done before shutting down and exiting */
    }

    static CURLcode test_unit9999(const char *arg)
    {
      UNITTEST_BEGIN(t9999_setup())

      /* here you start doing things and checking that the results are good */

      fail_unless( size == 0 , "initial size should be zero" );
      fail_if( head == NULL , "head should not be initiated to NULL" );

      /* you end the test code like this: */

      UNITTEST_END(t9999_stop())
    }

Testing static functions

Lots of internal functions are made static, and they should be static if they are private within a single source file.

The curl build system provides a way to write unit tests that let us properly test these functions while keeping them static in release builds.

A function that is static in the build but should be provided for unit testing needs to replace its static keyword with UNITTEST and it needs to have a prototype provided immediately above it.

An example add_two_integers() function for unit testing:


    UNITTEST int add_two_integers(int a, int b);
    UNITTEST int add_two_integers(int a, int b)
    {
      return a + b;
    }

Since the function is static and is private for this source file, it should not have its prototype in any header file.

When building unit tests, the build system automatically generates the lib/unitprotos.h header file with all the prototypes for UNITTEST functions provided in any libcurl C source code files. (This is done by the scripts/extract-unit-protos script.)