https://docs.shadowtraffic.ioAll the changes released to ShadowTraffichttps://docs.shadowtraffic.io/changelog/#1189https://docs.shadowtraffic.io/changelog/#1189Sat, 06 Jun 2026 00:28:43 GMT💪 Avoids failure to write to object storage when ShadowTraffic is run in a read-only container.https://docs.shadowtraffic.io/changelog/#1188https://docs.shadowtraffic.io/changelog/#1188Fri, 05 Jun 2026 16:15:21 GMT🐞 Fixes date/int type conversion for Iceberg partitioned tables.https://docs.shadowtraffic.io/changelog/#1187https://docs.shadowtraffic.io/changelog/#1187Fri, 05 Jun 2026 14:52:33 GMT🐞 Mitigates [CVE-2026-33117](https://nvd.nist.gov/vuln/detail/CVE-2026-33117).https://docs.shadowtraffic.io/changelog/#1186https://docs.shadowtraffic.io/changelog/#1186Thu, 04 Jun 2026 18:25:08 GMT💪 Improves memory utilization/performance for Iceberg, JSON, JSONL, and log serialization formats.https://docs.shadowtraffic.io/changelog/#1185https://docs.shadowtraffic.io/changelog/#1185Fri, 29 May 2026 16:53:09 GMT🐞 Fixes Redis's `unlink` startup policy for non-templated patterns in multi node clusters.https://docs.shadowtraffic.io/changelog/#1184https://docs.shadowtraffic.io/changelog/#1184Thu, 21 May 2026 15:30:22 GMT🐞 Mitigates [CVE-2026-45205](https://nvd.nist.gov/vuln/detail/CVE-2026-45205).https://docs.shadowtraffic.io/changelog/#1183https://docs.shadowtraffic.io/changelog/#1183Tue, 19 May 2026 22:38:41 GMT💪 Improves memory utilization and performance with Parquet serialization. 💪 Switches S3 to upload file parts in parallel.https://docs.shadowtraffic.io/changelog/#1182https://docs.shadowtraffic.io/changelog/#1182Wed, 13 May 2026 16:10:40 GMT💪 Lint mode now prints out validation errors if the configuration can't be recognized.https://docs.shadowtraffic.io/changelog/#1181https://docs.shadowtraffic.io/changelog/#1181Thu, 07 May 2026 15:05:28 GMT🐞 Mitigates [CVE-2026-42583](https://nvd.nist.gov/vuln/detail/CVE-2026-42583). 🐞 Mitigates [CVE-2026-42579](https://nvd.nist.gov/vuln/detail/CVE-2026-42579). 🐞 Mitigates [CVE-2026-42584](https://nvd.nist.gov/vuln/detail/CVE-2026-42584). 🐞 Mitigates [CVE-2026-42587](https://nvd.nist.gov/vuln/detail/CVE-2026-42587). 🐞 Mitigates [CVE-2026-41417](https://nvd.nist.gov/vuln/detail/CVE-2026-41417). 🐞 Mitigates [CVE-2026-42580](https://nvd.nist.gov/vuln/detail/CVE-2026-42580). 🐞 Mitigates [CVE-2026-42581](https://nvd.nist.gov/vuln/detail/CVE-2026-42581). 🐞 Mitigates [CVE-2026-42585](https://nvd.nist.gov/vuln/detail/CVE-2026-42585). 🐞 Mitigates [CVE-2026-42582](https://nvd.nist.gov/vuln/detail/CVE-2026-42582). 🐞 Mitigates [CVE-2026-44248](https://nvd.nist.gov/vuln/detail/CVE-2026-44248). 🐞 Mitigates [CVE-2026-42586](https://nvd.nist.gov/vuln/detail/CVE-2026-42586). 🐞 Mitigates [CVE-2026-42578](https://nvd.nist.gov/vuln/detail/CVE-2026-42578). 🐞 Mitigates [CVE-2026-42577](https://nvd.nist.gov/vuln/detail/CVE-2026-42577).https://docs.shadowtraffic.io/changelog/#1180https://docs.shadowtraffic.io/changelog/#1180Wed, 06 May 2026 16:48:36 GMT🎁 Adds Google Vertex as a model provider for the [`ai`](/functions/ai) function.https://docs.shadowtraffic.io/changelog/#11711https://docs.shadowtraffic.io/changelog/#11711Wed, 29 Apr 2026 19:40:54 GMT💪 Improves Iceberg writing performance.https://docs.shadowtraffic.io/changelog/#11710https://docs.shadowtraffic.io/changelog/#11710Tue, 28 Apr 2026 04:16:53 GMT🐞 Fixes bug that causes Iceberg files to split too quickly when using forks.https://docs.shadowtraffic.io/changelog/#1179https://docs.shadowtraffic.io/changelog/#1179Mon, 27 Apr 2026 16:10:21 GMT🐞 Makes ShadowTraffic's Iceberg writer resilient to AWS Glue throttling.https://docs.shadowtraffic.io/changelog/#1178https://docs.shadowtraffic.io/changelog/#1178Mon, 27 Apr 2026 13:57:44 GMT💪 Enhances the Iceberg writer to break apart batched rows that cross partition boundaries.https://docs.shadowtraffic.io/changelog/#1177https://docs.shadowtraffic.io/changelog/#1177Tue, 21 Apr 2026 22:58:24 GMT🐞 Fixes file size chunking when writing files to Iceberg. 🐞 Fixes pathalogical case that may deplete cache of the `string` function.https://docs.shadowtraffic.io/changelog/#1176https://docs.shadowtraffic.io/changelog/#1176Mon, 20 Apr 2026 20:11:55 GMT🐞 Fixes issues where Iceberg S3 files are written with a superfluous leading slash.https://docs.shadowtraffic.io/changelog/#1175https://docs.shadowtraffic.io/changelog/#1175Fri, 17 Apr 2026 20:38:17 GMT💪 Enables Iceberg formatted tables to work with AWS Glue.https://docs.shadowtraffic.io/changelog/#1174https://docs.shadowtraffic.io/changelog/#1174Fri, 17 Apr 2026 15:46:38 GMT🐞 Mitigates [CVE-2026-34477](https://nvd.nist.gov/vuln/detail/CVE-2026-34477). 🐞 Mitigates [CVE-2026-34478](https://nvd.nist.gov/vuln/detail/CVE-2026-34478). 🐞 Mitigates [CVE-2026-34480](https://nvd.nist.gov/vuln/detail/CVE-2026-34480).https://docs.shadowtraffic.io/changelog/#1173https://docs.shadowtraffic.io/changelog/#1173Fri, 17 Apr 2026 15:17:25 GMT🐞 Fixes Redis's `unlink` startup policy for multi node clusters.https://docs.shadowtraffic.io/changelog/#1172https://docs.shadowtraffic.io/changelog/#1172Wed, 15 Apr 2026 17:02:23 GMT💪 Adds new `startupPolicy` parameter for the [Redis connection](/connections/redis) to clear the key space before running.https://docs.shadowtraffic.io/changelog/#1171https://docs.shadowtraffic.io/changelog/#1171Tue, 14 Apr 2026 15:48:01 GMT💪 Adds OS wallclock time to debugging mode.https://docs.shadowtraffic.io/changelog/#1170https://docs.shadowtraffic.io/changelog/#1170Wed, 08 Apr 2026 20:09:08 GMT🎁 Adds new [Databricks](/connections/databricks) connection.https://docs.shadowtraffic.io/changelog/#1162https://docs.shadowtraffic.io/changelog/#1162Thu, 02 Apr 2026 22:54:19 GMT🐞 Mitigates [CVE-2026-33870](https://nvd.nist.gov/vuln/detail/CVE-2026-33870). 🐞 Mitigates [CVE-2026-33871](https://nvd.nist.gov/vuln/detail/CVE-2026-33871).https://docs.shadowtraffic.io/changelog/#1161https://docs.shadowtraffic.io/changelog/#1161Fri, 27 Mar 2026 15:03:10 GMT🐞 Mitigates [CVE-2025-67721](https://nvd.nist.gov/vuln/detail/CVE-2025-67721).https://docs.shadowtraffic.io/changelog/#1160https://docs.shadowtraffic.io/changelog/#1160Wed, 25 Mar 2026 22:16:01 GMT🎁 Adds new [Redis](/connections/redis) connection.https://docs.shadowtraffic.io/changelog/#1157https://docs.shadowtraffic.io/changelog/#1157Fri, 20 Mar 2026 21:51:04 GMT🐞 Fixes linter false positive on `stateMachine`'s `exposeVars` parameter.https://docs.shadowtraffic.io/changelog/#1156https://docs.shadowtraffic.io/changelog/#1156Wed, 11 Mar 2026 16:18:29 GMT🐞 Fixes peformance regression in [`histogram`](/functions/histogram/).https://docs.shadowtraffic.io/changelog/#1155https://docs.shadowtraffic.io/changelog/#1155Thu, 05 Mar 2026 18:51:50 GMT🐞 Mitigates [GHSA-72hv-8253-57qq](https://www.miggo.io/vulnerability-database/cve/GHSA-72hv-8253-57qq).https://docs.shadowtraffic.io/changelog/#1154https://docs.shadowtraffic.io/changelog/#1154Mon, 02 Mar 2026 23:50:00 GMT💪 Improves error messages from illegal Avro schema characters.https://docs.shadowtraffic.io/changelog/#1153https://docs.shadowtraffic.io/changelog/#1153Wed, 25 Feb 2026 19:53:22 GMT🎁 Adds new [`sqlHintDdl`](/generator-configuration/sqlDdlHint) configuration to specify SQL DDL statements directly.https://docs.shadowtraffic.io/changelog/#1152https://docs.shadowtraffic.io/changelog/#1152Mon, 23 Feb 2026 20:53:40 GMT🐞 Fixes false positive from linter on [`avroHint`](/function-modifiers/avroHint)https://docs.shadowtraffic.io/changelog/#1151https://docs.shadowtraffic.io/changelog/#1151Fri, 20 Feb 2026 17:26:12 GMT💪 Upgrades the [SQL Server connection](/connections/sqlServer) driver.https://docs.shadowtraffic.io/changelog/#1150https://docs.shadowtraffic.io/changelog/#1150Thu, 19 Feb 2026 16:10:18 GMT🎁 Adds new [`profile`](/functions/profile) function for generating realistic data about people.https://docs.shadowtraffic.io/changelog/#1146https://docs.shadowtraffic.io/changelog/#1146Wed, 18 Feb 2026 16:46:13 GMT🐞 Mitigates [CVE-2025-33042](https://nvd.nist.gov/vuln/detail/CVE-2025-33042).https://docs.shadowtraffic.io/changelog/#1145https://docs.shadowtraffic.io/changelog/#1145Thu, 12 Feb 2026 18:23:00 GMT🐞 Tightens schemas for [`string`](/functions/string), [`heading`](/functions/heading), and [`loadJsonFile`](/functions/loadJsonFile).https://docs.shadowtraffic.io/changelog/#1144https://docs.shadowtraffic.io/changelog/#1144Tue, 10 Feb 2026 19:02:15 GMT💪 Upates Docker base image to Wolfi-base, bringing its OS CVE count to near zero.https://docs.shadowtraffic.io/changelog/#1143https://docs.shadowtraffic.io/changelog/#1143Mon, 09 Feb 2026 21:34:40 GMT💪 Upgrades Docker base image to use a hardened version of Debian Bookworm, further reducing CVE surface area.https://docs.shadowtraffic.io/changelog/#1142https://docs.shadowtraffic.io/changelog/#1142Tue, 27 Jan 2026 21:25:07 GMT🐞 Fixes Kafka tombstone validation when using Schema Registry serializers. ShadowTraffic previously inappropriately applied schema checks on null value payloads.https://docs.shadowtraffic.io/changelog/#1141https://docs.shadowtraffic.io/changelog/#1141Thu, 22 Jan 2026 16:44:58 GMT💪 Postgres, MotherDuck, MySQL, SQL Server, and Oracle connections now log their DDL statements when they create tables for you. 🐞 Fixes spurious linter warning about [`customFunction`](/functions/customFunction/) argument maps.https://docs.shadowtraffic.io/changelog/#1140https://docs.shadowtraffic.io/changelog/#1140Tue, 20 Jan 2026 18:19:14 GMT💪 Switches Docker base image from Oracle Linux 9 to Debian Bookworm Slim. Debian's base image has a smaller footprint and reduced CVE surface. Unnecessary OS packages have been removed to further harden the image while retaining debugging utilities (`ping`, `curl`, `top`, `ps`, `netstat`). 🐞 Fixes spurious linter warning about [`geolocation`](/generator-configuration/geolocation/) configuration.https://docs.shadowtraffic.io/changelog/#1137https://docs.shadowtraffic.io/changelog/#1137Fri, 16 Jan 2026 16:43:42 GMT🐞 Mitigates [CVE-2025-68973](https://nvd.nist.gov/vuln/detail/CVE-2025-68973).https://docs.shadowtraffic.io/changelog/#1136https://docs.shadowtraffic.io/changelog/#1136Thu, 15 Jan 2026 18:39:15 GMT🐞 Fixes bug in [`repeatedly`](/functions/repeatedly) that prevented stateful functions from advancing in certain cases.https://docs.shadowtraffic.io/changelog/#1135https://docs.shadowtraffic.io/changelog/#1135Thu, 15 Jan 2026 17:33:43 GMT🎁 MotherDuck connections can now write to [multiple tables](/connections/motherduck/#writing-to-multiple-tables) and [multiple rows](/connections/motherduck/#writing-multiple-rows) per generation iteration.https://docs.shadowtraffic.io/changelog/#1134https://docs.shadowtraffic.io/changelog/#1134Fri, 09 Jan 2026 22:34:33 GMT🐞 Fixes issue where Kafka Data Quality rules may not fire for Avro serialized data.https://docs.shadowtraffic.io/changelog/#1133https://docs.shadowtraffic.io/changelog/#1133Fri, 09 Jan 2026 16:44:38 GMT🐞 Mitigates [CVE-2025-68161](https://nvd.nist.gov/vuln/detail/CVE-2025-68161).https://docs.shadowtraffic.io/changelog/#1132https://docs.shadowtraffic.io/changelog/#1132Wed, 07 Jan 2026 21:01:17 GMT🐞 Fixes `histogram` in [`lookup`](/functions/lookup) calls with multiple depending generators.https://docs.shadowtraffic.io/changelog/#1131https://docs.shadowtraffic.io/changelog/#1131Tue, 06 Jan 2026 18:25:45 GMT🎁 Adds new [`--reload` CLI flag](/cheatsheet/#cli-switches) to control when `--watch` interrupts existing runs. 💪 Updates the MotherDuck connection to permit [arbitrary query parameters](/connections/motherduck/#connecting-with-a-token) on the backing URL.https://docs.shadowtraffic.io/changelog/#1130https://docs.shadowtraffic.io/changelog/#1130Mon, 05 Jan 2026 20:02:05 GMT🎁 Adds new Google [PubSub connection](/connections/pubsub).https://docs.shadowtraffic.io/changelog/#1127https://docs.shadowtraffic.io/changelog/#1127Mon, 29 Dec 2025 22:34:22 GMT💪 `formatDateTime` can now [supply a timezone](/functions/formatDateTime/#set-the-timezone).https://docs.shadowtraffic.io/changelog/#1126https://docs.shadowtraffic.io/changelog/#1126Mon, 22 Dec 2025 18:58:08 GMT💪 Kafka topics can now be created with custom configuration.https://docs.shadowtraffic.io/changelog/#1125https://docs.shadowtraffic.io/changelog/#1125Fri, 19 Dec 2025 17:56:55 GMT🐞 Mitigates [CVE-2025-67735](https://nvd.nist.gov/vuln/detail/CVE-2025-67735).https://docs.shadowtraffic.io/changelog/#1124https://docs.shadowtraffic.io/changelog/#1124Wed, 17 Dec 2025 19:57:02 GMT💪 MotherDuck connection can now supply [table/column comments](/connections/motherduck/#object-comments).https://docs.shadowtraffic.io/changelog/#1123https://docs.shadowtraffic.io/changelog/#1123Mon, 15 Dec 2025 21:59:44 GMT💪 [`weightedOneOf`](/functions/weightedOneOf) can now take dynamic weights.https://docs.shadowtraffic.io/changelog/#1122https://docs.shadowtraffic.io/changelog/#1122Thu, 11 Dec 2025 23:33:33 GMT💪 Echos the version of ShadowTraffic you're running on startup. 🐞 Fixes spurious linter warnings on the `easing` and `easingChain` functions.https://docs.shadowtraffic.io/changelog/#1121https://docs.shadowtraffic.io/changelog/#1121Wed, 10 Dec 2025 21:31:31 GMT🐞 Fixes bug that prevented manual table policies from working with backticks in MySQL.https://docs.shadowtraffic.io/changelog/#1120https://docs.shadowtraffic.io/changelog/#1120Mon, 08 Dec 2025 22:14:26 GMT🐞 Fixes a deadlock bug that prevents shutdown when using the MotherDuck connection with a > 1 pool size. 💪 Adds logging to show MotherDuck connection acquisition timing.https://docs.shadowtraffic.io/changelog/#11114https://docs.shadowtraffic.io/changelog/#11114Fri, 05 Dec 2025 16:29:37 GMT🐞 Fixes OS CVEs in the ShadowTraffic Oracle Linux base image.https://docs.shadowtraffic.io/changelog/#11113https://docs.shadowtraffic.io/changelog/#11113Wed, 03 Dec 2025 22:50:26 GMT🐞 Fixes collision when the [built-in linter](/cheatsheet/#linting-your-configuration) doesn't correctly run preprocessing functions (like [`loadJsonFile`](/functions/loadJsonFile)) ahead of time.https://docs.shadowtraffic.io/changelog/#11112https://docs.shadowtraffic.io/changelog/#11112Tue, 02 Dec 2025 18:06:28 GMT🐞 Fixes [`repeatedly`](/functions/repeatedly) to correctly track stateful, nested function calls.https://docs.shadowtraffic.io/changelog/#11111https://docs.shadowtraffic.io/changelog/#11111Mon, 17 Nov 2025 23:19:44 GMT🐞 Fixes linter bug misapplied to reader generators.https://docs.shadowtraffic.io/changelog/#11110https://docs.shadowtraffic.io/changelog/#11110Mon, 17 Nov 2025 18:45:58 GMT🐞 Fixes spurious linter warnings on startup for some functions.https://docs.shadowtraffic.io/changelog/#1119https://docs.shadowtraffic.io/changelog/#1119Sat, 15 Nov 2025 02:10:46 GMT🐞 Fixes a regression in the MotherDuck connection, introduced in 1.11.5, that can prevent ShadowTraffic from writing greater than 100K rows to MotherDuck.https://docs.shadowtraffic.io/changelog/#1118https://docs.shadowtraffic.io/changelog/#1118Thu, 13 Nov 2025 18:05:33 GMT💪 Automatically includes [lint output](/cheatsheet/#linting-your-configuration) when generating data, too.https://docs.shadowtraffic.io/changelog/#1117https://docs.shadowtraffic.io/changelog/#1117Wed, 12 Nov 2025 23:05:45 GMT🎁 Adds new [built-in linter](/cheatsheet/#linting-your-configuration) to detect unrecognized ShadowTraffic parameters.https://docs.shadowtraffic.io/changelog/#1116https://docs.shadowtraffic.io/changelog/#1116Wed, 05 Nov 2025 21:45:28 GMT💪 S3, Google Cloud Storage, Azure Blob Storage, and file system connectors can now specify `customSuffix` to override their file output extensions.https://docs.shadowtraffic.io/changelog/#1115https://docs.shadowtraffic.io/changelog/#1115Wed, 05 Nov 2025 18:49:29 GMT🎁 Adds support for [connection pooling](/connections/motherduck/#connection-pooling) in a single MotherDuck connection.https://docs.shadowtraffic.io/changelog/#1114https://docs.shadowtraffic.io/changelog/#1114Tue, 04 Nov 2025 21:08:26 GMT🐞 Fixes bug where MotherDuck tables were always created in the default schema. Tables can now be fully qualified with `db.schema.table` syntax.https://docs.shadowtraffic.io/changelog/#1113https://docs.shadowtraffic.io/changelog/#1113Mon, 03 Nov 2025 17:51:08 GMT🐞 Fixes reader generator metrics on the MotherDuck connection.https://docs.shadowtraffic.io/changelog/#1112https://docs.shadowtraffic.io/changelog/#1112Mon, 27 Oct 2025 23:55:55 GMT💪 [`stateMachine`](/functions/stateMachine) can now take functional arguments for both its `initial` and `transitions` parameter, making it more customizable.https://docs.shadowtraffic.io/changelog/#1111https://docs.shadowtraffic.io/changelog/#1111Fri, 24 Oct 2025 20:12:02 GMT🐞 Fixes spurious stacktrace during shutdown of a long running MotherDuck connection.https://docs.shadowtraffic.io/changelog/#1110https://docs.shadowtraffic.io/changelog/#1110Fri, 24 Oct 2025 01:54:19 GMT🎁 Adds new [`interpolate`](/functions/interpolate) function. 🎁 Adds the ability to issue [reader traffic](/connections/motherduck/#generating-reads) to MotherDuck connections.https://docs.shadowtraffic.io/changelog/#1101https://docs.shadowtraffic.io/changelog/#1101Wed, 22 Oct 2025 02:18:14 GMT💪 Dramatically improves MotherDuck insertion performance. 🐞 Fixes Postgres table creation bug introduced in previous release.https://docs.shadowtraffic.io/changelog/#1100https://docs.shadowtraffic.io/changelog/#1100Mon, 20 Oct 2025 22:26:16 GMT🎁 Adds new connection for [MotherDuck](/connections/motherduck).https://docs.shadowtraffic.io/changelog/#193https://docs.shadowtraffic.io/changelog/#193Thu, 16 Oct 2025 20:39:15 GMT🐞 Fixes a bug that caused `maxEvents` to prematurely terminate a generator under certain conditions, like forks with high number of contending keys.https://docs.shadowtraffic.io/changelog/#192https://docs.shadowtraffic.io/changelog/#192Thu, 16 Oct 2025 17:25:52 GMT💪 Kafka connections will now log [how their schemas were selected from Schema registry](/connections/kafka/#schema-selection). 🐞 Fixes vars not correctly getting passed to [`customFunction`](/functions/customFunction) calls.https://docs.shadowtraffic.io/changelog/#191https://docs.shadowtraffic.io/changelog/#191Wed, 15 Oct 2025 19:08:08 GMT💪 Introduces batching to the [KurrentDB](/connections/kurrentdb) connection.https://docs.shadowtraffic.io/changelog/#190https://docs.shadowtraffic.io/changelog/#190Tue, 14 Oct 2025 22:03:55 GMT💪 Upgrades the dependencies underpinning [Kafka](/connections/kafka) to Confluent 8.0. 💪 Upgrades the EventStore connection to the latest, newly branded [KurrentDB](/connections/kurrentdb).https://docs.shadowtraffic.io/changelog/#189https://docs.shadowtraffic.io/changelog/#189Wed, 08 Oct 2025 18:56:03 GMT🐞 Fixes bug where [`time`](/generator-configuration/time) wasn't respected as a global configuration parameter.https://docs.shadowtraffic.io/changelog/#188https://docs.shadowtraffic.io/changelog/#188Tue, 07 Oct 2025 02:31:13 GMT🐞 Fixes bug where Avro schemas would be incorrectly constructed on dynamically nested arrays.https://docs.shadowtraffic.io/changelog/#187https://docs.shadowtraffic.io/changelog/#187Fri, 03 Oct 2025 16:51:23 GMT💪 Extends [`serialize`](/function-modifiers/serialize) to handle SQL Server native datetime columns.https://docs.shadowtraffic.io/changelog/#186https://docs.shadowtraffic.io/changelog/#186Fri, 03 Oct 2025 16:16:45 GMT🐞 Removes hanging debug statement from previous release.https://docs.shadowtraffic.io/changelog/#185https://docs.shadowtraffic.io/changelog/#185Fri, 03 Oct 2025 15:58:27 GMT💪 The metrics port can now be set with `--metrics-port`, and set to `0` to randomize its value.https://docs.shadowtraffic.io/changelog/#184https://docs.shadowtraffic.io/changelog/#184Wed, 01 Oct 2025 20:21:30 GMT🐞 Fixes ShadowTraffic Studio's display when multiple generators share the same output target. 🐞 Fixes SQL Server connection always writing to the default `dbo` schema.https://docs.shadowtraffic.io/changelog/#183https://docs.shadowtraffic.io/changelog/#183Mon, 29 Sep 2025 17:22:12 GMT💪 Adds support for [v7 UUIDs](/functions/uuid).https://docs.shadowtraffic.io/changelog/#182https://docs.shadowtraffic.io/changelog/#182Thu, 25 Sep 2025 21:12:03 GMT💪 Permits dynamic values in [`easing`](/functions/easing)'s `duration` and `events` parameters.https://docs.shadowtraffic.io/changelog/#181https://docs.shadowtraffic.io/changelog/#181Wed, 24 Sep 2025 20:44:26 GMT💪 Performs a deep merge when [`loadJsonFile`](/functions/loadJsonFile) is used with an array of files, making it easier to specify nested overrides.https://docs.shadowtraffic.io/changelog/#180https://docs.shadowtraffic.io/changelog/#180Mon, 22 Sep 2025 16:52:42 GMT🎁 Adds support for direct Iceberg writes to [S3](/connections/s3/#writing-iceberg-data), [GCS](/connections/googleCloudStorage/#writing-iceberg-data), [Azure](/connections/azureBlobStorage/#writing-iceberg-data), and [file system connections](/connections/filesystem/#writing-iceberg-data).https://docs.shadowtraffic.io/changelog/#171https://docs.shadowtraffic.io/changelog/#171Mon, 15 Sep 2025 18:13:32 GMT🎁 [`easing`](/functions/easing) and [`easingChain`](/functions/easingChain) can now iterate along a number of events, not just a timed duration.https://docs.shadowtraffic.io/changelog/#170https://docs.shadowtraffic.io/changelog/#170Tue, 09 Sep 2025 16:10:11 GMT🎁 Adds new [`duration`](/functions/duration) function for expressing wallclock values. 🐞 Fixes `multiBlob` Parquet serialization with the file system connection. 🐞 Adds launch-time validation to catch illegal `lookup` function calls to future schedule `stages` that haven't yet run.https://docs.shadowtraffic.io/changelog/#163https://docs.shadowtraffic.io/changelog/#163Mon, 08 Sep 2025 17:26:38 GMT🐞 Fixes Parquet serialization when `multiBlob` is used with S3 and other object stores. It previously applied an incorrect schema per blob.https://docs.shadowtraffic.io/changelog/#162https://docs.shadowtraffic.io/changelog/#162Fri, 05 Sep 2025 14:44:22 GMT🐞 Mitigates [CVE-2025-58056](https://nvd.nist.gov/vuln/detail/CVE-2025-58056). 🐞 Mitigates [CVE-2025-58057](https://nvd.nist.gov/vuln/detail/CVE-2025-58057).https://docs.shadowtraffic.io/changelog/#161https://docs.shadowtraffic.io/changelog/#161Thu, 04 Sep 2025 15:05:56 GMT🐞 Fixes bug in [`math`](/functions/math) that would throw a stacktrace when `expr` is missing instead of a helpful error message.https://docs.shadowtraffic.io/changelog/#160https://docs.shadowtraffic.io/changelog/#160Wed, 03 Sep 2025 19:11:32 GMT🎁 Adds new [AI function](/functions/ai) that can generate free text from AWS Bedrock and Ollama.https://docs.shadowtraffic.io/changelog/#158https://docs.shadowtraffic.io/changelog/#158Tue, 02 Sep 2025 16:00:14 GMT🐞 [`multiBlob` S3 support](/connections/s3/#writing-multiple-blobs) now raises launch-time error when there are missing keys.https://docs.shadowtraffic.io/changelog/#157https://docs.shadowtraffic.io/changelog/#157Thu, 21 Aug 2025 17:53:55 GMT💪 [`easing`](/functions/easing) can now take dynamic `to` and `from` parameters.https://docs.shadowtraffic.io/changelog/#156https://docs.shadowtraffic.io/changelog/#156Mon, 18 Aug 2025 22:12:51 GMT🎁 Adds new [`sample`](/function-modifiers/sample) function modifier.https://docs.shadowtraffic.io/changelog/#155https://docs.shadowtraffic.io/changelog/#155Thu, 14 Aug 2025 21:05:32 GMT🎁 Adds the ability to write [multiple files per iteration](/connections/s3/#writing-multiple-blobs) to the S3 connection.https://docs.shadowtraffic.io/changelog/#154https://docs.shadowtraffic.io/changelog/#154Thu, 14 Aug 2025 15:26:52 GMT🐞 Fixes a bug in Kafka schema inference that creates single-type unions.https://docs.shadowtraffic.io/changelog/#153https://docs.shadowtraffic.io/changelog/#153Thu, 14 Aug 2025 14:57:45 GMT🐞 Fixes an issue where [`bytes`](/functions/bytes) would emit too many bytes when serialized with Avro through Kafka. 🐞 Fixes poor Avro validation error messages when serializing incorrect deeply nested, unionized data. 🐞 Mitigates [CVE-2024-57699](https://nvd.nist.gov/vuln/detail/CVE-2024-57699).https://docs.shadowtraffic.io/changelog/#152https://docs.shadowtraffic.io/changelog/#152Wed, 13 Aug 2025 18:25:42 GMT🐞 Fixes a bug where Avro serialization errors would falsely claim valid data is the problem. In particular, it would incorrectly target records with an implicit parent namespace.https://docs.shadowtraffic.io/changelog/#151https://docs.shadowtraffic.io/changelog/#151Tue, 12 Aug 2025 19:06:41 GMT🐞 Fixes a bug where [scheduled](/schedule/stages/) generators couldn't [lookup](/functions/lookup/) each other if they shared the same name.https://docs.shadowtraffic.io/changelog/#150https://docs.shadowtraffic.io/changelog/#150Tue, 12 Aug 2025 17:49:08 GMT🎁 Adds new functions [`easing`](/functions/easing) and [`easingChain`](/functions/easingChain) to transition numeric values over time. 🐞 Allows [`throughput`](/generator-configuration/throughput/) to be set by a variable.https://docs.shadowtraffic.io/changelog/#143https://docs.shadowtraffic.io/changelog/#143Fri, 08 Aug 2025 14:37:24 GMT💪 Allows [`throughput`](/generator-configuration/throughput/) to take dynamic values. The docs previously erroneously specified it could do this.https://docs.shadowtraffic.io/changelog/#142https://docs.shadowtraffic.io/changelog/#142Wed, 06 Aug 2025 21:03:03 GMT🐞 Fixes authentication forwarding for auto-schema downloading with Kafka connections.https://docs.shadowtraffic.io/changelog/#141https://docs.shadowtraffic.io/changelog/#141Wed, 06 Aug 2025 20:37:52 GMT🐞 Fixes a spurious authentication issue with Kafka Schema Registry when using SR-enabled serializers.https://docs.shadowtraffic.io/changelog/#140https://docs.shadowtraffic.io/changelog/#140Wed, 06 Aug 2025 17:54:16 GMT🐞 Fixes a performance regression when using `lookup` with `histogram`. Large lookup targets > 10K elements would dramatically reduce output speed. This is now fixed.https://docs.shadowtraffic.io/changelog/#130https://docs.shadowtraffic.io/changelog/#130Mon, 04 Aug 2025 19:09:11 GMT🎁 Adds the ability for Kafka generators to [automatically download schemas](/connections/kafka#automatic-schema-downloading) out of Schema Registry.https://docs.shadowtraffic.io/changelog/#120https://docs.shadowtraffic.io/changelog/#120Thu, 31 Jul 2025 16:48:08 GMT🎁 Adds support for Kafka/Confluent client-side field level encryption (AWS, Azure, GCP, Vault, and local). Follow [Confluent's docs](https://docs.confluent.io/cloud/current/security/encrypt/csfle/client-side.html) to enable it.https://docs.shadowtraffic.io/changelog/#1111https://docs.shadowtraffic.io/changelog/#1111Mon, 28 Jul 2025 18:49:18 GMT🎁 Adds new function [`cache`](/functions/cache) to create dynamic, immutable relationships. 🐞 Mitigates [CVE-2025-53864](https://nvd.nist.gov/vuln/detail/CVE-2025-53864). 🐞 Mitigates [CVE-2025-48924](https://nvd.nist.gov/vuln/detail/CVE-2025-48924).https://docs.shadowtraffic.io/changelog/#1110https://docs.shadowtraffic.io/changelog/#1110Wed, 23 Jul 2025 22:27:52 GMT💪 [`intervals`](/functions/intervals) no longer requires a fallback value or index.https://docs.shadowtraffic.io/changelog/#119https://docs.shadowtraffic.io/changelog/#119Wed, 23 Jul 2025 17:10:21 GMT🎁 Adds new function [`cycle`](/functions/cycle) to emit looping sequences of elements.https://docs.shadowtraffic.io/changelog/#118https://docs.shadowtraffic.io/changelog/#118Mon, 14 Jul 2025 17:58:08 GMT💪 Loosens the schema for [`waypoints`](/functions/waypoints) so that `coordinates` can be an array of function calls.https://docs.shadowtraffic.io/changelog/#117https://docs.shadowtraffic.io/changelog/#117Fri, 11 Jul 2025 15:09:41 GMT🐞 Mitigates [CVE-2025-5702](https://nvd.nist.gov/vuln/detail/CVE-2025-5702). 🐞 Mitigates [CVE-2025-49794](https://nvd.nist.gov/vuln/detail/CVE-2025-49794). 🐞 Mitigates [CVE-2025-6021](https://nvd.nist.gov/vuln/detail/CVE-2025-6021).https://docs.shadowtraffic.io/changelog/#116https://docs.shadowtraffic.io/changelog/#116Wed, 09 Jul 2025 17:34:30 GMT💪 Adds the ability to [nest identifiers](/functions/string/#nesting-datafaker-functions) in the `string` function.https://docs.shadowtraffic.io/changelog/#115https://docs.shadowtraffic.io/changelog/#115Wed, 02 Jul 2025 18:56:11 GMT💪 Permits `startingFrom` in [`sequentialString`](/functions/sequentialString) to be a function call. 🐞 Fixes a bug related to [`customFunction`](/functions/customFunction) that would incorrectly advance other fields state.https://docs.shadowtraffic.io/changelog/#114https://docs.shadowtraffic.io/changelog/#114Tue, 01 Jul 2025 19:03:42 GMT🐞 Fixes a bug in ShadowTraffic Studio that crashes the UI when state machine delays are used.https://docs.shadowtraffic.io/changelog/#113https://docs.shadowtraffic.io/changelog/#113Tue, 01 Jul 2025 18:20:59 GMT💪 Adds the ability for state machines to [delay arbitrary states](/functions/stateMachine/#overriding-delay-conditions).https://docs.shadowtraffic.io/changelog/#112https://docs.shadowtraffic.io/changelog/#112Fri, 27 Jun 2025 18:55:57 GMT🐞 Mitigates [CVE-2025-6020](https://nvd.nist.gov/vuln/detail/CVE-2025-6020). 🐞 Mitigates [CVE-2025-48976](https://nvd.nist.gov/vuln/detail/CVE-2025-48976). 🐞 Mitigates [CVE-2025-25724](https://nvd.nist.gov/vuln/detail/CVE-2025-25724). 🐞 Mitigates [CVE-2025-3576](https://nvd.nist.gov/vuln/detail/CVE-2025-3576).https://docs.shadowtraffic.io/changelog/#111https://docs.shadowtraffic.io/changelog/#111Mon, 23 Jun 2025 15:55:28 GMT💪 Improves error messages from AWS KMS while creating leases.https://docs.shadowtraffic.io/changelog/#110https://docs.shadowtraffic.io/changelog/#110Wed, 18 Jun 2025 17:44:20 GMT🎁 Adds new [MySQL](/connections/mysql) connection.https://docs.shadowtraffic.io/changelog/#1010https://docs.shadowtraffic.io/changelog/#1010Fri, 13 Jun 2025 15:42:19 GMT🐞 Mitigates [CVE-2025-4802](https://nvd.nist.gov/vuln/detail/CVE-2025-4802).https://docs.shadowtraffic.io/changelog/#109https://docs.shadowtraffic.io/changelog/#109Tue, 10 Jun 2025 16:35:00 GMT🎁 Adds new [`avroHint`](/function-modifiers/avroHint) function modifier to override automatic schema inference guesses.https://docs.shadowtraffic.io/changelog/#108https://docs.shadowtraffic.io/changelog/#108Wed, 04 Jun 2025 22:25:44 GMT🐞 Fixes bug where named `lookup` calls against the same collection would collide results.https://docs.shadowtraffic.io/changelog/#107https://docs.shadowtraffic.io/changelog/#107Wed, 04 Jun 2025 16:02:21 GMT💪 Improves error output when ShadowTraffic is fed an invalid license.https://docs.shadowtraffic.io/changelog/#106https://docs.shadowtraffic.io/changelog/#106Tue, 03 Jun 2025 18:33:45 GMT🐞 Fixes Avro schema inference bug on array types.https://docs.shadowtraffic.io/changelog/#105https://docs.shadowtraffic.io/changelog/#105Mon, 02 Jun 2025 18:34:14 GMT🐞 Mitigates [CVE-2025-30065](https://nvd.nist.gov/vuln/detail/CVE-2025-30065). 🐞 Mitigates [CVE-2025-48734](https://nvd.nist.gov/vuln/detail/CVE-2025-48734). 🐞 Mitigates [CVE-2025-46762](https://nvd.nist.gov/vuln/detail/CVE-2025-46762). 🐞 Mitigates [CVE-2022-49043](https://nvd.nist.gov/vuln/detail/CVE-2022-49043). 🐞 Mitigates [CVE-2024-56171](https://nvd.nist.gov/vuln/detail/CVE-2024-56171). 🐞 Mitigates [CVE-2025-24928](https://nvd.nist.gov/vuln/detail/CVE-2025-24928). 🐞 Mitigates [CVE-2024-12797](https://nvd.nist.gov/vuln/detail/CVE-2024-12797). 🐞 Mitigates [CVE-2025-4598](https://nvd.nist.gov/vuln/detail/CVE-2025-4598). 🐞 Mitigates [CVE-2020-11023](https://nvd.nist.gov/vuln/detail/CVE-2020-11023). 🐞 Mitigates [CVE-2025-0395](https://nvd.nist.gov/vuln/detail/CVE-2025-0395). 🐞 Mitigates [CVE-2019-12900](https://nvd.nist.gov/vuln/detail/CVE-2019-12900). 🐞 Mitigates [CVE-2025-24528](https://nvd.nist.gov/vuln/detail/CVE-2025-24528). 🐞 Mitigates [CVE-2024-8176](https://nvd.nist.gov/vuln/detail/CVE-2024-8176). 🐞 Mitigates [CVE-2024-12243](https://nvd.nist.gov/vuln/detail/CVE-2024-12243). 🐞 Mitigates [CVE-2024-12133](https://nvd.nist.gov/vuln/detail/CVE-2024-12133).https://docs.shadowtraffic.io/changelog/#104https://docs.shadowtraffic.io/changelog/#104Wed, 28 May 2025 17:53:32 GMT💪 Defaults ShadowTraffic to use 65% of available container memory, increased from 25%. 💪 Adds [concurrency and buffer depth](/connections/s3/#adjusting-concurrency) parameters for S3. 🐞 Fixes an issue with the S3 connection where large objects could deplete memory.https://docs.shadowtraffic.io/changelog/#103https://docs.shadowtraffic.io/changelog/#103Thu, 15 May 2025 21:36:00 GMT🐞 Fixes Unicode rendering issues related to GraalVM that would emit `?` characters in some log lines.https://docs.shadowtraffic.io/changelog/#102https://docs.shadowtraffic.io/changelog/#102Thu, 15 May 2025 18:14:49 GMT💪 Narrows the scope of state that `customFunction` calls carry to minimize type conversion errors.https://docs.shadowtraffic.io/changelog/#101https://docs.shadowtraffic.io/changelog/#101Wed, 14 May 2025 16:57:35 GMT🐞 Fixes `customFunction` composite types caused by some JavaScript return values.https://docs.shadowtraffic.io/changelog/#100https://docs.shadowtraffic.io/changelog/#100Tue, 13 May 2025 21:22:41 GMT🎁 Introduces [`customFunction`](/functions/customFunction) that lets you extend ShadowTraffic with Python, Ruby, and JavaScript. 💪 Changes the default JVM to use GraalVM 23.0.2, mainly in support of custom functions.https://docs.shadowtraffic.io/changelog/#0194https://docs.shadowtraffic.io/changelog/#0194Mon, 28 Apr 2025 17:51:34 GMT💪 Deprecates `toInstant` and instead adds a new [`serialize`](/function-modifiers/serialize#serialize-to-postgres-timestamp) target for Postgres timestamps. This makes it easier decouple type-system specifics from the data you're generating.https://docs.shadowtraffic.io/changelog/#0193https://docs.shadowtraffic.io/changelog/#0193Mon, 28 Apr 2025 16:20:53 GMT🐞 Expands [`waypoints`](/functions/waypoints) so that its `coordinates` parameter can be resolved through lookups.https://docs.shadowtraffic.io/changelog/#0192https://docs.shadowtraffic.io/changelog/#0192Fri, 25 Apr 2025 19:36:01 GMT🎁 Adds new function modifier [`serialize`](/function-modifiers/serialize) to control last mile byte arrangement.https://docs.shadowtraffic.io/changelog/#0191https://docs.shadowtraffic.io/changelog/#0191Mon, 21 Apr 2025 16:31:42 GMT🐞 Fixes a bug where stateful functions would fail if nested under `map` calls.https://docs.shadowtraffic.io/changelog/#0190https://docs.shadowtraffic.io/changelog/#0190Tue, 15 Apr 2025 22:40:33 GMT🎁 Adds new [leasing capability](/cheatsheet/#creating-short-term-leases) for Enterprise users. Leasing allows central teams to issue scoped, short-term access to subteams.https://docs.shadowtraffic.io/changelog/#0189https://docs.shadowtraffic.io/changelog/#0189Mon, 14 Apr 2025 19:27:27 GMT🐞 Fixes further edge cases continuing through Kafka data quality rules errors.https://docs.shadowtraffic.io/changelog/#0188https://docs.shadowtraffic.io/changelog/#0188Wed, 09 Apr 2025 20:28:28 GMT💪 Dramatically improves the helpfulness of error messages related to Kafka Avro serialization.https://docs.shadowtraffic.io/changelog/#0187https://docs.shadowtraffic.io/changelog/#0187Mon, 07 Apr 2025 15:44:20 GMT🐞 Fixes issues related to Kafka data quality rules suppressing errors. 💪 Relaxes schema of [`lookup`](/functions/lookup) to no longer require `path`.https://docs.shadowtraffic.io/changelog/#0186https://docs.shadowtraffic.io/changelog/#0186Fri, 04 Apr 2025 21:10:15 GMT🎁 [Adds new parameter](/connections/kafka/#triggering-data-quality-rules) to continue generating data to Kafka when data quality rules are violated.https://docs.shadowtraffic.io/changelog/#0185https://docs.shadowtraffic.io/changelog/#0185Wed, 02 Apr 2025 21:47:15 GMT🐞 Fixes `--bootstrap-from-avro-schema` to correctly handle union types by specifying type hints in generated output.https://docs.shadowtraffic.io/changelog/#0184https://docs.shadowtraffic.io/changelog/#0184Wed, 02 Apr 2025 20:06:08 GMT💪 Expands `elide`'s [`whenAbsent`](/function-modifiers/elide/#eliding-with-absence) check to trigger on `false` too, not just `null`. 💪 `--bootstrap` will now bundle the original schema as a hint with Kafka targeted generators. 🐞 Swaps the order the `decimals` and `clamp` modifiers run. `decimals` now runs afterward since clamp may introduce more floating point places.https://docs.shadowtraffic.io/changelog/#0183https://docs.shadowtraffic.io/changelog/#0183Tue, 01 Apr 2025 18:24:56 GMT🐞 Fixes a bug where reusing a generator across `stages` could throw an exception.https://docs.shadowtraffic.io/changelog/#0182https://docs.shadowtraffic.io/changelog/#0182Mon, 31 Mar 2025 17:49:40 GMT💪 Upgrades the set of available [Kafka serializers](/connections/kafka#built-in-serializers) and permits use of `kafka-schema-rules`.https://docs.shadowtraffic.io/changelog/#0181https://docs.shadowtraffic.io/changelog/#0181Mon, 31 Mar 2025 15:15:38 GMT🐞 Fixes a bug where `schedule` may throw an exception when used with `--stdout`. 🐞 Fixes `--bootstrap-*` commands for Kafka to now output the right corresponding serializers for the requested format.https://docs.shadowtraffic.io/changelog/#0180https://docs.shadowtraffic.io/changelog/#0180Tue, 25 Mar 2025 17:05:42 GMT⚠️ Breaking change: all events are now instantaneously available through the [`lookup`](/functions/lookup) function. The previous behavior, which prevented events from being looked up until they were acknowledged by the target backend systems, [consistently caused confusion](https://github.com/ShadowTraffic/requests/issues/9). This change now unifies how data is generated with and without the `--stdout` flag. See below to restore the old behavior. 🎁 Adds new [`lookupScope`](/generator-configuration/lookupScope) configuration. Set this value to `committed` to [restore the old behavior](/generator-configuration/lookupScope/#setting-committed-scope). 🙅 Drops the `--allow-unsafe-lookups` CLI flag. Use `lookupScope` instead.https://docs.shadowtraffic.io/changelog/#01716https://docs.shadowtraffic.io/changelog/#01716Mon, 24 Mar 2025 20:23:10 GMT💪 Allows [concurrency tuning](/connections/azureBlobStorage/#adjusting-concurrency) for the Azure Blob Storage connector.https://docs.shadowtraffic.io/changelog/#01715https://docs.shadowtraffic.io/changelog/#01715Tue, 18 Mar 2025 19:42:38 GMT💪 Allows [`defaultValue` parameter](/functions/previousEvent/#setting-a-default-value) for `previousEvent` to be a function.https://docs.shadowtraffic.io/changelog/#01714https://docs.shadowtraffic.io/changelog/#01714Mon, 17 Mar 2025 16:43:26 GMT💪 Adds support for YAML configuration files through the [`--config-format`](/cheatsheet#cli-switches) command line switch. 💪 Adds new [`defaultValue` parameter](/functions/previousEvent/#setting-a-default-value) for `previousEvent`.https://docs.shadowtraffic.io/changelog/#01713https://docs.shadowtraffic.io/changelog/#01713Thu, 13 Mar 2025 22:25:01 GMT🐞 Fixes `geolocation` support, which recently broke through the underlying Docker image dependencies.https://docs.shadowtraffic.io/changelog/#01712https://docs.shadowtraffic.io/changelog/#01712Tue, 11 Mar 2025 19:01:43 GMT💪 Improves the performance of the Azure Blob Storage connector for large events.https://docs.shadowtraffic.io/changelog/#01711https://docs.shadowtraffic.io/changelog/#01711Thu, 06 Mar 2025 21:05:51 GMT🐞 Fixes `toInstant`'s schema not requiring the `ms` parameter.https://docs.shadowtraffic.io/changelog/#01710https://docs.shadowtraffic.io/changelog/#01710Wed, 05 Mar 2025 19:28:08 GMT🐞 Fixes a bug where UUIDs weren't casting correctly to Postgres. 🐞 Fixes Postgres `dropAndCreate` so that drops cascading, avoiding throwing errors on dependent object chains.https://docs.shadowtraffic.io/changelog/#0179https://docs.shadowtraffic.io/changelog/#0179Wed, 05 Mar 2025 17:25:47 GMT🐞 Fixes bug where top-level [`math`](/functions/math) variables that refer to other variables could evaluate in the wrong order.https://docs.shadowtraffic.io/changelog/#0178https://docs.shadowtraffic.io/changelog/#0178Tue, 04 Mar 2025 19:24:53 GMT💪 Adds new [`logLevel` parameter](/connections/s3/#changing-the-log-level) for S3 to more easily debug unexpected authentication issues.https://docs.shadowtraffic.io/changelog/#0177https://docs.shadowtraffic.io/changelog/#0177Tue, 04 Mar 2025 17:45:32 GMT🎁 Adds new [`log` format](/connections/filesystem/#writing-log-files) for file system, S3, GCS, and Azure Blob Storage. The same parameter works across all 4 connectors.https://docs.shadowtraffic.io/changelog/#0176https://docs.shadowtraffic.io/changelog/#0176Mon, 03 Mar 2025 18:46:58 GMT🎁 Adds [new debugging mode](/cheatsheet/#debugging-the-container), activated by the `SHADOWTRAFFIC_DEBUG` environment variable.https://docs.shadowtraffic.io/changelog/#0175https://docs.shadowtraffic.io/changelog/#0175Mon, 03 Mar 2025 17:38:14 GMT🎁 Adds new [`sendSynchronous` parameter](/connections/kafka/#sending-events-synchronously) for the Kafka connection.https://docs.shadowtraffic.io/changelog/#0174https://docs.shadowtraffic.io/changelog/#0174Fri, 28 Feb 2025 19:59:53 GMT🎁 Configuration files can now contain JavaScript style comments (both `//` single line and slash asterisks multiline). If use comments, you may want to suffix your configuration files with `*.js` so your editor tolerates them.https://docs.shadowtraffic.io/changelog/#0173https://docs.shadowtraffic.io/changelog/#0173Thu, 27 Feb 2025 18:12:45 GMT💪 Web hook generators can now use [a URL suffix](/connections/webhook/#vary-the-url) to vary the called endpoint. 💪 Web hook `maxRequests` can be set to `0` to [force synchronous request/response exchanges](/connections/webhook/#synchronous-requests). 🐞 Fixes bug where [`printExchange`](/connections/webhook/#log-requestresponse-pairs) on webhook wouldn't run on non-200 HTTP responses.https://docs.shadowtraffic.io/changelog/#0172https://docs.shadowtraffic.io/changelog/#0172Wed, 26 Feb 2025 19:40:24 GMT💪 Adds the ability to [log HTTP exchanges](/connections/webhook/#log-requestresponse-pairs) in the `webhook` connector. 🐞 Fixes a bug that caused output to interleave when using `stages` with Kafka. Previously, the underlying Kafka producer did not flush its buffer between stages, which could cause out of order output on the topic's partitions.https://docs.shadowtraffic.io/changelog/#0171https://docs.shadowtraffic.io/changelog/#0171Tue, 25 Feb 2025 21:54:59 GMT🎁 `--config` can now take a URL to download from a network/the internet.https://docs.shadowtraffic.io/changelog/#0170https://docs.shadowtraffic.io/changelog/#0170Sat, 22 Feb 2025 00:03:45 GMT🎁 Adds a new connector for [Oracle](/connections/oracle). 🙅 Drops support for TimePlus. 🙅 Drops support for Proton. 🐞 Mitigates [CVE-2025-24970](https://nvd.nist.gov/vuln/detail/CVE-2025-25193). 🐞 Mitigates [CVE-2025-25193](https://nvd.nist.gov/vuln/detail/CVE-2025-25193).https://docs.shadowtraffic.io/changelog/#0165https://docs.shadowtraffic.io/changelog/#0165Thu, 20 Feb 2025 18:27:41 GMT💪 File suffixes generated by the [file connection](/connections/filesystem) will now always increase in strict order.https://docs.shadowtraffic.io/changelog/#0164https://docs.shadowtraffic.io/changelog/#0164Wed, 19 Feb 2025 16:55:37 GMT🎁 Adds the ability to [retain history during discards](/generator-configuration/discard/#retain-history).https://docs.shadowtraffic.io/changelog/#0163https://docs.shadowtraffic.io/changelog/#0163Tue, 18 Feb 2025 23:43:20 GMT🎁 Adds auth mechanisms to connect to Kafka clusters hosted on Amazon MSK.https://docs.shadowtraffic.io/changelog/#0162https://docs.shadowtraffic.io/changelog/#0162Fri, 14 Feb 2025 20:37:34 GMT🐞 Fixes static variable validation check missed parent-defined `repeatedly` local variables.https://docs.shadowtraffic.io/changelog/#0161https://docs.shadowtraffic.io/changelog/#0161Fri, 14 Feb 2025 19:11:26 GMT🐞 Fixes `loadJsonFile` not printing enough error information during some misconfigured multi-file loads.https://docs.shadowtraffic.io/changelog/#0160https://docs.shadowtraffic.io/changelog/#0160Thu, 13 Feb 2025 23:30:16 GMT⚠️ Breaking change: the [`fileSystem`](/connections/filesystem) has been updated to require a directory at the generator-level instead of a connection level. This makes it identical in behavior to the S3, Azure, and GCS connectors. Apologies for the breakage. 🎁 Adds the ability to [merge multiple JSON files together](/functions/loadJsonFile/#merging-files) during preprocessing. 🎁 Adds the ability to write multiple files for both [file system](/connections/filesystem/#writing-multiple-files) and [Azure](/connections/azureBlobStorage/#writing-multiple-blobs) connections. 🎁 Adds new serialization option [`explodeJsonlArrays`](/connections/filesystem/#set-the-format-and-compression) to break arrays onto multiple lines. 🎁 Adds new optional [`localVars`](/functions/repeatedly/#setting-local-variables) parameter to `repeatedly` to specify local, randomized values. 🎁 S3, Azure, GCS, and file system connections can now [turn off batching](/connections/filesystem/#instantly-flush-files) and instantenously write files on each iteration.https://docs.shadowtraffic.io/changelog/#0158https://docs.shadowtraffic.io/changelog/#0158Thu, 13 Feb 2025 20:44:20 GMT🐞 Fixes additional SSL connections issues with Kafka and Java 23.https://docs.shadowtraffic.io/changelog/#0157https://docs.shadowtraffic.io/changelog/#0157Mon, 10 Feb 2025 16:55:58 GMT🎁 Adds new `--allow-unsafe-lookups` CLI flag. This flag allows `lookup` to access uncommitted data, which is required for generating identical data streams to asynchronously written connections. In other words, this flag allows you to trade safety for determinism.https://docs.shadowtraffic.io/changelog/#0156https://docs.shadowtraffic.io/changelog/#0156Wed, 05 Feb 2025 23:00:43 GMT💪 Adds explicit support for S3 [path-style access](/connections/s3/#connecting-to-minio), which is useful for S3-compatible services like MinIO. 🐞 Fixes Kafka SSL connectivity, which regressed in 0.15.0 after upgrading the backing Docker image to Java 23.https://docs.shadowtraffic.io/changelog/#0155https://docs.shadowtraffic.io/changelog/#0155Wed, 05 Feb 2025 18:41:16 GMT🐞 Fixes a bug where nested `stateMachine` calls wouldn't terminate the generator when they had no further transitions.https://docs.shadowtraffic.io/changelog/#0154https://docs.shadowtraffic.io/changelog/#0154Wed, 05 Feb 2025 18:10:11 GMT🐞 Mitigates [CVE-2024-7254](https://nvd.nist.gov/vuln/detail/cve-2024-7254).https://docs.shadowtraffic.io/changelog/#0153https://docs.shadowtraffic.io/changelog/#0153Tue, 04 Feb 2025 23:10:18 GMT🐞 Fixes a regression introduced in 0.15.0 where S3 connections would crash in certain environments.https://docs.shadowtraffic.io/changelog/#0152https://docs.shadowtraffic.io/changelog/#0152Tue, 04 Feb 2025 21:41:11 GMT🐞 Fixes a bug where ShadowTraffic would crash if a variable referred to another variable that called `lookup`.https://docs.shadowtraffic.io/changelog/#0151https://docs.shadowtraffic.io/changelog/#0151Tue, 04 Feb 2025 03:24:32 GMT🐞 Mitigates [CVE-2024-6763](https://nvd.nist.gov/vuln/detail/CVE-2024-6763). 🐞 Mitigates [CVE-2023-40167](https://nvd.nist.gov/vuln/detail/CVE-2023-40167).https://docs.shadowtraffic.io/changelog/#0150https://docs.shadowtraffic.io/changelog/#0150Mon, 03 Feb 2025 23:53:17 GMT🐞 Fixes bug that would spawn forks out of order when using `maxForks` with `keepAlive`. 🐞 Mitigates [CVE-2024-22871](https://nvd.nist.gov/vuln/detail/CVE-2024-22871). 🐞 Mitigates [CVE-2024-23944](https://nvd.nist.gov/vuln/detail/cve-2024-23944). 🐞 Mitigates [CVE-2024-12801](https://nvd.nist.gov/vuln/detail/CVE-2024-12801). 🐞 Mitigates [CVE-2024-12798](https://nvd.nist.gov/vuln/detail/CVE-2024-12798). 🐞 Mitigates [CVE-2023-6378](https://nvd.nist.gov/vuln/detail/cve-2023-6378). 🐞 Mitigates [CVE-2023-52428](https://nvd.nist.gov/vuln/detail/cve-2023-6378). 🐞 Mitigates [CVE-2024-25638](https://nvd.nist.gov/vuln/detail/cve-2024-25638). 🐞 Mitigates [CVE-2023-5072](https://nvd.nist.gov/vuln/detail/cve-2023-5072). 🐞 Mitigates [CVE-2024-29133](https://nvd.nist.gov/vuln/detail/cve-2024-29133). 🐞 Mitigates [CVE-2024-29131](https://nvd.nist.gov/vuln/detail/cve-2024-29131). 🐞 Mitigates [CVE-2024-8184](https://nvd.nist.gov/vuln/detail/CVE-2024-8184). 🐞 Mitigates [CVE-2019-9674](https://nvd.nist.gov/vuln/detail/CVE-2019-9674). 🐞 Mitigates [CVE-2024-9681](https://nvd.nist.gov/vuln/detail/CVE-2024-9681). 🐞 Mitigates [CVE-2023-27043](https://nvd.nist.gov/vuln/detail/CVE-2023-27043). 🐞 Mitigates [CVE-2024-5535](https://nvd.nist.gov/vuln/detail/CVE-2024-5535). 🐞 Mitigates [CVE-2024-43802](https://nvd.nist.gov/vuln/detail/CVE-2024-43802). 🐞 Mitigates [CVE-2024-34459](https://nvd.nist.gov/vuln/detail/CVE-2024-34459). 🐞 Mitigates [CVE-2024-33600](https://nvd.nist.gov/vuln/detail/CVE-2024-33600). 🐞 Mitigates [CVE-2024-39689](https://nvd.nist.gov/vuln/detail/CVE-2024-39689). 🐞 Mitigates [CVE-2024-47561](https://nvd.nist.gov/vuln/detail/CVE-2024-47561). 🐞 Mitigates [CVE-2022-25647](https://nvd.nist.gov/vuln/detail/CVE-2022-25647). 🐞 Mitigates [CVE-2024-47554](https://nvd.nist.gov/vuln/detail/CVE-2024-47554). 🐞 Mitigates [CVE-2024-45490](https://nvd.nist.gov/vuln/detail/CVE-2024-45490). 🐞 Mitigates [CVE-2023-44487](https://nvd.nist.gov/vuln/detail/CVE-2023-44487). 🐞 Mitigates [CVE-2023-39410](https://nvd.nist.gov/vuln/detail/CVE-2023-39410). 🐞 Mitigates [CVE-2023-36478](https://nvd.nist.gov/vuln/detail/CVE-2023-36478). 🐞 Mitigates [CVE-2015-5652](https://nvd.nist.gov/vuln/detail/CVE-2015-5652). 🐞 Mitigates [CVE-2023-2976](https://nvd.nist.gov/vuln/detail/CVE-2023-2976). 🐞 Mitigates [CVE-2022-26488](https://nvd.nist.gov/vuln/detail/CVE-2022-26488). 🐞 Mitigates [CVE-2024-26308](https://nvd.nist.gov/vuln/detail/CVE-2024-26308). 🐞 Mitigates [CVE-2024-25710](https://nvd.nist.gov/vuln/detail/CVE-2024-25710). 🐞 Mitigates [CVE-2023-41900](https://nvd.nist.gov/vuln/detail/CVE-2023-41900). 🐞 Mitigates [CVE-2023-36479](https://nvd.nist.gov/vuln/detail/CVE-2023-36479). 🐞 Mitigates [CVE-2020-8908](https://nvd.nist.gov/vuln/detail/CVE-2020-8908).https://docs.shadowtraffic.io/changelog/#0146https://docs.shadowtraffic.io/changelog/#0146Mon, 03 Feb 2025 19:29:03 GMT🎁 Adds the ability for `lookup` calls to access [intermediate variables](/functions/lookup/#accessing-variables) on the target events.https://docs.shadowtraffic.io/changelog/#0145https://docs.shadowtraffic.io/changelog/#0145Fri, 31 Jan 2025 22:51:47 GMT🎁 Adds new [`strategy`](/functions/lookup) parameter to `lookup` to bias how events are chosen: first, last, or randomized.https://docs.shadowtraffic.io/changelog/#0144https://docs.shadowtraffic.io/changelog/#0144Tue, 28 Jan 2025 19:29:39 GMT🐞 Fixes bug where file connections that use `subdir` could roll the same file suffix multiple times.https://docs.shadowtraffic.io/changelog/#0143https://docs.shadowtraffic.io/changelog/#0143Tue, 28 Jan 2025 16:30:54 GMT💪 Increases the speed with which new forks are launched, which is helpful if you're starting a large number of small forks.https://docs.shadowtraffic.io/changelog/#0142https://docs.shadowtraffic.io/changelog/#0142Mon, 27 Jan 2025 21:16:38 GMT💪 Changes the semantics of [fork keys](/fork/key/) so that if `key` is ever `null`, an error is raised. Previously, ShadowTraffic would silently stop forking, which was confusing and unhelpful. 🐞 Fixes a bug where the use of [`oneTimeKeys`](/fork/oneTimeKeys) would not always allow ShadowTraffic to exit if it generated all expected data. 🐞 Fixes bootstrap generated output that targets Kafka connections. Previously the default Kafka connection URL was malformed.https://docs.shadowtraffic.io/changelog/#0141https://docs.shadowtraffic.io/changelog/#0141Tue, 21 Jan 2025 18:17:45 GMT🎁 [File system](/connections/filesystem/#writing-to-subdirectories) and [Azure Blob Storage](/connections/azureBlobStorage/#writing-to-subdirectories) connections now support writing to subdirectories.https://docs.shadowtraffic.io/changelog/#0140https://docs.shadowtraffic.io/changelog/#0140Sat, 18 Jan 2025 00:32:54 GMT🎁 Adds support for [external Avro references](/connections/kafka/#resolving-avro-schema-references) in Kafka connections.https://docs.shadowtraffic.io/changelog/#01311https://docs.shadowtraffic.io/changelog/#01311Wed, 15 Jan 2025 20:23:32 GMT🐞 Fixes lack of schema checks on `map` function. 🐞 Fixes situation where using `iterateVars` on `repeatedly` would break with nested variables.https://docs.shadowtraffic.io/changelog/#01310https://docs.shadowtraffic.io/changelog/#01310Tue, 14 Jan 2025 22:32:59 GMT💪 Improves the error message raised when you using Avro with missing fields in a record.https://docs.shadowtraffic.io/changelog/#0139https://docs.shadowtraffic.io/changelog/#0139Mon, 13 Jan 2025 20:33:26 GMT🎁 Adds new `--report-benchmark` command line flag to print performance metrics after data generation completes.https://docs.shadowtraffic.io/changelog/#0138https://docs.shadowtraffic.io/changelog/#0138Thu, 02 Jan 2025 16:48:02 GMT💪 Improves the performance of `weightedOneOf`.https://docs.shadowtraffic.io/changelog/#0137https://docs.shadowtraffic.io/changelog/#0137Fri, 13 Dec 2024 19:33:25 GMT🐞 Fixes bug where `oneOf` and `weightedOneOf` may throw exceptions when used with subnested, stateful functions.https://docs.shadowtraffic.io/changelog/#0136https://docs.shadowtraffic.io/changelog/#0136Fri, 13 Dec 2024 18:35:33 GMT💪 Adds new [`loopAfter`](/functions/sequentialInteger/#loop-the-value) parameter to `sequentialInteger`.https://docs.shadowtraffic.io/changelog/#0135https://docs.shadowtraffic.io/changelog/#0135Fri, 13 Dec 2024 15:57:48 GMT💪 Improves performance related to throttling generators. 🐞 Removes stray debug output.https://docs.shadowtraffic.io/changelog/#0134https://docs.shadowtraffic.io/changelog/#0134Thu, 12 Dec 2024 22:18:44 GMT🐞 Fixes a bug where ShadowTraffic might hang when using more outgoing connections than number of cores on the machine.https://docs.shadowtraffic.io/changelog/#0133https://docs.shadowtraffic.io/changelog/#0133Wed, 11 Dec 2024 19:07:18 GMT💪 Adds parameter for [`characterString`](/functions/characterString/#generating-unique-strings) to generate only unique chars.https://docs.shadowtraffic.io/changelog/#0132https://docs.shadowtraffic.io/changelog/#0132Mon, 09 Dec 2024 19:31:56 GMT🐞 Fixes issue with EventStore client where certain exceptions were suppressed.https://docs.shadowtraffic.io/changelog/#0131https://docs.shadowtraffic.io/changelog/#0131Fri, 06 Dec 2024 20:22:24 GMT🐞 Fixes ShadowTraffic from hanging on termination. This bug was introduced in 0.12.9https://docs.shadowtraffic.io/changelog/#0130https://docs.shadowtraffic.io/changelog/#0130Thu, 05 Dec 2024 17:46:18 GMT🎁 [--bootstrap](/cheatsheet/#bootstrap) now supports Avro schema files as input.https://docs.shadowtraffic.io/changelog/#01215https://docs.shadowtraffic.io/changelog/#01215Wed, 04 Dec 2024 20:29:29 GMT💪 Adds support for method, headers, and query parameters in the webhook connection.https://docs.shadowtraffic.io/changelog/#01214https://docs.shadowtraffic.io/changelog/#01214Tue, 03 Dec 2024 19:26:42 GMT💪 `lookup` can now [target generators by name](/functions/lookup/#lookup-by-name).https://docs.shadowtraffic.io/changelog/#01213https://docs.shadowtraffic.io/changelog/#01213Mon, 02 Dec 2024 22:05:21 GMT🐞 Fixes fork keys functions that use internal state from throwing errors.https://docs.shadowtraffic.io/changelog/#01212https://docs.shadowtraffic.io/changelog/#01212Mon, 02 Dec 2024 17:52:19 GMT💪 Adds optional `keyPrefix` for lookups against S3 and Azure Blob Storage to narrow searched output. 🐞 Fixes `sequentialString` by requiring the presence of an `expr` parameter.https://docs.shadowtraffic.io/changelog/#01211https://docs.shadowtraffic.io/changelog/#01211Mon, 02 Dec 2024 16:10:24 GMT🐞 Fixes `--bootstrap` so only zero-argument Faker expressions are generated. This means the backing configuration file will always work with no further modifications.https://docs.shadowtraffic.io/changelog/#01210https://docs.shadowtraffic.io/changelog/#01210Wed, 27 Nov 2024 17:04:46 GMT🐞 Fixes an additional memory leak related to serializing Parquet data.https://docs.shadowtraffic.io/changelog/#0129https://docs.shadowtraffic.io/changelog/#0129Wed, 27 Nov 2024 06:57:05 GMT🐞 Fixes a memory leak affecting long-lived generators that write to S3, Google Cloud Storage, Azure Blob Storage, Postgres, and file systems.https://docs.shadowtraffic.io/changelog/#0128https://docs.shadowtraffic.io/changelog/#0128Mon, 18 Nov 2024 19:04:15 GMT🎁 Bootstrap now uses prediction to guess string expressions rather than defaulting to a single stub expression.https://docs.shadowtraffic.io/changelog/#0127https://docs.shadowtraffic.io/changelog/#0127Mon, 18 Nov 2024 16:57:47 GMT🐞 Fixes `--bootstrap-to` bug for fileSystem, proton, and timeplus arguments.https://docs.shadowtraffic.io/changelog/#0126https://docs.shadowtraffic.io/changelog/#0126Fri, 15 Nov 2024 22:44:23 GMT🎁 Adds new [`--bootstrap`](/cheatsheet/#bootstrap) command line switch to automatically generate ShadowTraffic files from JSON Schema files.https://docs.shadowtraffic.io/changelog/#0125https://docs.shadowtraffic.io/changelog/#0125Thu, 14 Nov 2024 20:42:33 GMT💪 Adds [optional `blobPrefix`](/connections/googleCloudStorage/#multiple-lookups) to Google Cloud Storage `lookup` calls so narrow searched output.https://docs.shadowtraffic.io/changelog/#0124https://docs.shadowtraffic.io/changelog/#0124Thu, 14 Nov 2024 19:17:21 GMT🐞 Fixes ShadowTraffic Studio from rendering bad output if loaded mid-run.https://docs.shadowtraffic.io/changelog/#0123https://docs.shadowtraffic.io/changelog/#0123Wed, 13 Nov 2024 21:14:39 GMT🐞 Fixes leaked library debug message on startup. 💪 Improves baseline performance by about 50%.https://docs.shadowtraffic.io/changelog/#0122https://docs.shadowtraffic.io/changelog/#0122Tue, 12 Nov 2024 21:41:59 GMT🎁 Allows [`string`](/functions/string/#overriding-the-locale)'s locale to be overriden, defaulting to United States/English.https://docs.shadowtraffic.io/changelog/#0121https://docs.shadowtraffic.io/changelog/#0121Fri, 08 Nov 2024 19:10:55 GMT💪 Improves the performance of [`cardinality`](/function-modifiers/cardinality) when used with [`sequentialInteger`](/functions/sequentialInteger)https://docs.shadowtraffic.io/changelog/#0120https://docs.shadowtraffic.io/changelog/#0120Thu, 07 Nov 2024 19:34:54 GMT💪 Improves baseline performance of ShadowTraffic by about 25%. 💪 Replaces `string` templating library with Datafaker, resulting in much higher performance for string operations. 💪 Switches `S3` connection to use concurrent uploads. Keys will begin uploading in serial order, but may complete out of order.https://docs.shadowtraffic.io/changelog/#0115https://docs.shadowtraffic.io/changelog/#0115Tue, 05 Nov 2024 21:46:04 GMT💪 Improves the performance of the `string` function by eliding unused code.https://docs.shadowtraffic.io/changelog/#0114https://docs.shadowtraffic.io/changelog/#0114Tue, 05 Nov 2024 16:07:19 GMT🐞 Fixes `cardinality` from working with certain stateful functions.https://docs.shadowtraffic.io/changelog/#0113https://docs.shadowtraffic.io/changelog/#0113Tue, 29 Oct 2024 15:05:56 GMT💪 Allows configuring [log level](/connections/kafka/#changing-the-log-level) connections to Kafka.https://docs.shadowtraffic.io/changelog/#0112https://docs.shadowtraffic.io/changelog/#0112Thu, 24 Oct 2024 16:19:41 GMT🐞 Fixes ShadowTraffic Studio failing to render data on state machines with overriden throttles.https://docs.shadowtraffic.io/changelog/#0111https://docs.shadowtraffic.io/changelog/#0111Wed, 23 Oct 2024 16:42:25 GMT🐞 Fixes the EventStore client from suppressing connection errors if ShadowTraffic exits too quickly.https://docs.shadowtraffic.io/changelog/#0110https://docs.shadowtraffic.io/changelog/#0110Tue, 22 Oct 2024 21:08:40 GMT💪 Deprecates `kafkaKeyAvroSchemaHint`, `kafkaValueAvroSchemaHint`, `kafkaKeyProtobufSchemaHint`, and `kafkaValueProtobufSchemaHint` in favor of two simpler configurations: [`avroSchemaHint`](/generator-configuration/avroSchemaHint) and [`protobufSchemaHint`](/generator-configuration/protobufSchemaHint).https://docs.shadowtraffic.io/changelog/#01011https://docs.shadowtraffic.io/changelog/#01011Tue, 22 Oct 2024 15:26:00 GMT🐞 Fixes bug where multiple `sequentialInteger` calls in the same level of a map would erase each other's state.https://docs.shadowtraffic.io/changelog/#01010https://docs.shadowtraffic.io/changelog/#01010Mon, 21 Oct 2024 22:57:59 GMT🎁 Adds support for new [`jsonSchemaHint`](/generator-configuration/jsonSchemaHint) for Kafka serialization.https://docs.shadowtraffic.io/changelog/#0109https://docs.shadowtraffic.io/changelog/#0109Mon, 21 Oct 2024 21:44:50 GMT🐞 Fixes `timeMultiplier` throwing spurious errors. 🐞 Fixes bug causing competiting state in `vars` and `stateMachine` not to advance correctly.https://docs.shadowtraffic.io/changelog/#0108https://docs.shadowtraffic.io/changelog/#0108Wed, 16 Oct 2024 17:40:34 GMT🎁 S3, Google Cloud Storage, Azure Blob Storage, and filesystem connections now support batching on number of serialized bytes with `batchBytes`. 🎁 Adds uniform support for `json`, pretty `json`, `jsonl`, and `parquet` as serialization options for S3, Google Cloud Storage, Azure Blob Storage, and filesystem connections. 🎁 Ditto for compression: all of these connections now support `gzip`.https://docs.shadowtraffic.io/changelog/#0107https://docs.shadowtraffic.io/changelog/#0107Tue, 15 Oct 2024 15:43:30 GMT🐞 Fixes regression on updates and deletes to Postgres connection.https://docs.shadowtraffic.io/changelog/#0106https://docs.shadowtraffic.io/changelog/#0106Mon, 14 Oct 2024 20:46:46 GMT🎁 Adds Parquet serialization support for Google Cloud Storage.https://docs.shadowtraffic.io/changelog/#0105https://docs.shadowtraffic.io/changelog/#0105Mon, 14 Oct 2024 17:46:09 GMT🐞 Fixes `uniformDistribution` throwing error on decimal bounds under `1`.https://docs.shadowtraffic.io/changelog/#0104https://docs.shadowtraffic.io/changelog/#0104Fri, 11 Oct 2024 20:37:01 GMT🐞 Fixes EventStore connection `eventId` fields not handling UUIDs correctly.https://docs.shadowtraffic.io/changelog/#0103https://docs.shadowtraffic.io/changelog/#0103Fri, 11 Oct 2024 18:34:00 GMT🐞 Removes addresses from `geolocation` that don't specify a city.https://docs.shadowtraffic.io/changelog/#0102https://docs.shadowtraffic.io/changelog/#0102Fri, 11 Oct 2024 15:02:36 GMT💪 Fixes error output from the webhook connector when connections timeout.https://docs.shadowtraffic.io/changelog/#0101https://docs.shadowtraffic.io/changelog/#0101Thu, 10 Oct 2024 18:56:57 GMT🎁 Adds new [`keepAlive`](/fork/keepAlive) parameter so that forks can continue to respawn even after reaching `maxForks`.https://docs.shadowtraffic.io/changelog/#0100https://docs.shadowtraffic.io/changelog/#0100Wed, 09 Oct 2024 19:59:56 GMT🎁 Adds support for [SQL Server](/connections/sqlServer). 💪 Allows top-level `stateMachine` functions to [override](/functions/stateMachine/#overriding-throttle-values) `throttleMs` local configuration.https://docs.shadowtraffic.io/changelog/#0910https://docs.shadowtraffic.io/changelog/#0910Tue, 08 Oct 2024 22:15:51 GMT🐞 Fixes JSON formatting in ShadowTraffic Studio for booleans and UUIDs.https://docs.shadowtraffic.io/changelog/#099https://docs.shadowtraffic.io/changelog/#099Tue, 08 Oct 2024 17:48:41 GMT💪 Adds new optional `names` parameter to the `math` function to isolate local variable usage. 🐞 Fixes error message from the `math` function when the expression is malformed.https://docs.shadowtraffic.io/changelog/#098https://docs.shadowtraffic.io/changelog/#098Mon, 07 Oct 2024 22:49:50 GMT💪 Increases the default settings of the webhook connection to support higher concurrency.https://docs.shadowtraffic.io/changelog/#097https://docs.shadowtraffic.io/changelog/#097Mon, 07 Oct 2024 22:23:37 GMT💪 Exposes `maxRequests` parameter in the webhook connection to control request concurrency.https://docs.shadowtraffic.io/changelog/#096https://docs.shadowtraffic.io/changelog/#096Mon, 07 Oct 2024 17:59:18 GMT🐞 Fixes [CVE-2024-47561](https://www.cve.org/CVERecord?id=CVE-2024-47561) pertaining to Avro. 💪 Upgrades Confluent Kafka serializers to 7.7.1https://docs.shadowtraffic.io/changelog/#095https://docs.shadowtraffic.io/changelog/#095Thu, 03 Oct 2024 22:07:47 GMT💪 Adds support for new `string` function transformation `removeSubstring`. 🐞 Fixes uncaught error when `uniformDistributionBoundaries` aren't legal. A better error is now printed.https://docs.shadowtraffic.io/changelog/#094https://docs.shadowtraffic.io/changelog/#094Thu, 03 Oct 2024 17:38:01 GMT🐞 Adds guards to prevent the webhook connection from exhausting memory on too many outbound requests.https://docs.shadowtraffic.io/changelog/#093https://docs.shadowtraffic.io/changelog/#093Wed, 02 Oct 2024 21:16:49 GMT💪 Dramatically improves the performance of the webhook connection.https://docs.shadowtraffic.io/changelog/#092https://docs.shadowtraffic.io/changelog/#092Wed, 02 Oct 2024 18:40:46 GMT🐞 Fixes how UUIDs are printed in ShadowTraffic Studio. 🐞 Fixes timeline stretching beyond viewport in ShadowTraffic Studio.https://docs.shadowtraffic.io/changelog/#091https://docs.shadowtraffic.io/changelog/#091Tue, 01 Oct 2024 21:59:57 GMT🎁 Adds new [ulid](/functions/ulid) function.https://docs.shadowtraffic.io/changelog/#090https://docs.shadowtraffic.io/changelog/#090Tue, 01 Oct 2024 16:12:41 GMT🎁 Adds new connection for [Google Cloud Storage](/connections/googleCloudStorage).https://docs.shadowtraffic.io/changelog/#0812https://docs.shadowtraffic.io/changelog/#0812Thu, 26 Sep 2024 15:18:48 GMT🐞 Fixes bug preventing UUIDs from being written as a first-class type to Postgres with `pgHint`.https://docs.shadowtraffic.io/changelog/#0811https://docs.shadowtraffic.io/changelog/#0811Wed, 25 Sep 2024 21:30:06 GMT🐞 Fixes vertical scrolling in ShadowTraffic Studio with a large number of generators.https://docs.shadowtraffic.io/changelog/#0810https://docs.shadowtraffic.io/changelog/#0810Tue, 24 Sep 2024 22:43:14 GMT💪 Extends `maxBytes` to work for Kafka and webhook connections.https://docs.shadowtraffic.io/changelog/#089https://docs.shadowtraffic.io/changelog/#089Tue, 24 Sep 2024 21:46:10 GMT🎁 Adds new [`maxBytes`](/generator-configuration/maxBytes) configuration to limit the number of data written to an output connection. Note this currently only works with S3, Azure Blob Storage, and file system connections.https://docs.shadowtraffic.io/changelog/#088https://docs.shadowtraffic.io/changelog/#088Tue, 24 Sep 2024 18:58:45 GMT🎁 Adds new [`throughput`](/generator-configuration/throughput) configuration to control how many events per second are generated.https://docs.shadowtraffic.io/changelog/#087https://docs.shadowtraffic.io/changelog/#087Mon, 23 Sep 2024 19:57:04 GMT🐞 Fixes broken images in ShadowTraffic Studio when used with Chrome.https://docs.shadowtraffic.io/changelog/#086https://docs.shadowtraffic.io/changelog/#086Mon, 23 Sep 2024 18:05:45 GMT💪 Improves the error message when Protobuf schema hints aren't set correctly.https://docs.shadowtraffic.io/changelog/#085https://docs.shadowtraffic.io/changelog/#085Mon, 23 Sep 2024 17:53:46 GMT🎁 Adds new Kafka type hints for Protobuf serialization: `kafkaKeyProtobufHint` and `kafkaValueProtobufHint`.https://docs.shadowtraffic.io/changelog/#084https://docs.shadowtraffic.io/changelog/#084Fri, 20 Sep 2024 16:23:13 GMT💪 Adds new `advanceBy` parameter to [`sequentialInteger`](/functions/sequentialInteger) and allows both the starting and step values to be functions.https://docs.shadowtraffic.io/changelog/#083https://docs.shadowtraffic.io/changelog/#083Wed, 11 Sep 2024 19:37:03 GMT🎁 Adds new [`cardinality`](/function-modifiers/cardinality) function modifier to limit the number of uniquely generated values.https://docs.shadowtraffic.io/changelog/#082https://docs.shadowtraffic.io/changelog/#082Tue, 10 Sep 2024 22:25:55 GMT🐞 Fixes visibility of `lookup` calls from forked generators in ShadowTraffic Studio.https://docs.shadowtraffic.io/changelog/#081https://docs.shadowtraffic.io/changelog/#081Mon, 09 Sep 2024 21:42:29 GMT💪 Drops `dataShape` parameter from webhooks, allowing arbitrary shapes of data to be generated. 🙅 Drops top-level Decodable support, which was misdesigned as a piggyback onto webhooks.https://docs.shadowtraffic.io/changelog/#080https://docs.shadowtraffic.io/changelog/#080Mon, 09 Sep 2024 16:33:35 GMT💪 Improves schema checks on fork configuration. 🐞 Raises an error when the reserved var `mapItem` is used outside of a `mapEach` call. 🙅 Removes deprecated `geospatialPath` and `geospatialPathScheme` functions. Use [`waypoints`](/functions/waypoints) instead.https://docs.shadowtraffic.io/changelog/#0723https://docs.shadowtraffic.io/changelog/#0723Thu, 05 Sep 2024 20:05:24 GMT🐞 Fixes `forkKey` variable references in `varsOnce` blocks. These previously returned `null` always.https://docs.shadowtraffic.io/changelog/#0722https://docs.shadowtraffic.io/changelog/#0722Wed, 04 Sep 2024 21:34:31 GMT🐞 Fixes `lookup` calls in `varOnce` blocks. These previously returned `null`.https://docs.shadowtraffic.io/changelog/#0721https://docs.shadowtraffic.io/changelog/#0721Tue, 03 Sep 2024 22:00:02 GMT💪 Permits `null` transitions in state machines to terminate the generator early.https://docs.shadowtraffic.io/changelog/#0720https://docs.shadowtraffic.io/changelog/#0720Tue, 03 Sep 2024 18:28:02 GMT🐞 Fixes bug that corrupted state when using multiple, inline state machines.https://docs.shadowtraffic.io/changelog/#0719https://docs.shadowtraffic.io/changelog/#0719Tue, 03 Sep 2024 16:20:33 GMT💪 Permits dynamic key prefixes for Azure Blob Storage. 💪 Improves pretty printing on deeply nested data when using --stdout.https://docs.shadowtraffic.io/changelog/#0718https://docs.shadowtraffic.io/changelog/#0718Fri, 30 Aug 2024 20:17:20 GMT💪 Loosens the JSON schema for Kafka connections, permitting an open-ended range of authentication methods and parameters.https://docs.shadowtraffic.io/changelog/#0717https://docs.shadowtraffic.io/changelog/#0717Fri, 30 Aug 2024 19:45:36 GMT💪 Prints out the offending line and column number when the configuration file fails JSON parsing.https://docs.shadowtraffic.io/changelog/#0716https://docs.shadowtraffic.io/changelog/#0716Thu, 29 Aug 2024 17:04:15 GMT🙅 Removes `pluckEach` in favor of a more general solution. See next lines. 🎁 Adds new function [`mapEach`](/functions/mapEach) that supports general transformations of arrays. 🎁 Adds new reserved variable `mapItem`.https://docs.shadowtraffic.io/changelog/#0715https://docs.shadowtraffic.io/changelog/#0715Wed, 28 Aug 2024 22:29:14 GMT🐞 Allows fork keys to be traced as origins in ShadowTraffic Studio.https://docs.shadowtraffic.io/changelog/#0714https://docs.shadowtraffic.io/changelog/#0714Wed, 28 Aug 2024 21:32:20 GMT💪 Allows `add`, `subtract`, `multiply`, `divide`, `min`, and `max` to take functions as arguments instead on only arrays.https://docs.shadowtraffic.io/changelog/#0713https://docs.shadowtraffic.io/changelog/#0713Wed, 28 Aug 2024 21:22:27 GMT🎁 Adds new `pluckEach` transformation function.https://docs.shadowtraffic.io/changelog/#0712https://docs.shadowtraffic.io/changelog/#0712Fri, 23 Aug 2024 15:47:43 GMT🎁 Adds new [`clamp`](/function-modifiers/clamp) function modifier.https://docs.shadowtraffic.io/changelog/#0711https://docs.shadowtraffic.io/changelog/#0711Wed, 21 Aug 2024 21:35:29 GMT🐞 Fixes ShadowTraffic Studio running with development-time resources instead of a production build.https://docs.shadowtraffic.io/changelog/#0710https://docs.shadowtraffic.io/changelog/#0710Tue, 20 Aug 2024 22:40:06 GMT🎁 Adds new [`oneTimeKeys`](/fork/oneTimeKeys) parameter to fork, making it possible for terminates forks to never restart. 💪 Loosens `stateMachine` schema and allows sequential state transitions to run `0` times. This is useful if you want to sometimes run a state and sometimes skip it.https://docs.shadowtraffic.io/changelog/#079https://docs.shadowtraffic.io/changelog/#079Mon, 19 Aug 2024 20:42:37 GMT💪 Adds new optional `compression` parameter to the S3 connection.https://docs.shadowtraffic.io/changelog/#078https://docs.shadowtraffic.io/changelog/#078Fri, 16 Aug 2024 17:30:36 GMT💪 [`math`](/functions/math) now produces a better error when you reference a variable that evaluates to `null`.https://docs.shadowtraffic.io/changelog/#077https://docs.shadowtraffic.io/changelog/#077Thu, 15 Aug 2024 18:12:58 GMT💪 Changes file suffixes for the S3 and Azure Blob Storage connections to use ULIDs instead of nanosecond timestamps. This ensures multiple writers won't collide and write to the same file, while still making the file names sortable.https://docs.shadowtraffic.io/changelog/#076https://docs.shadowtraffic.io/changelog/#076Tue, 13 Aug 2024 16:13:59 GMT💪 Adds new `whenPresent` and `whenAbsent` parameters for the [`elide`](/function-modifiers/elide) function modifier. 🐞 Fixes schema check for `null` rateshttps://docs.shadowtraffic.io/changelog/#075https://docs.shadowtraffic.io/changelog/#075Mon, 12 Aug 2024 22:58:03 GMT🐞 Fixes `elide` used in the position of an array index. This would previously raise an exception.https://docs.shadowtraffic.io/changelog/#074https://docs.shadowtraffic.io/changelog/#074Mon, 12 Aug 2024 20:27:43 GMT🐞 Fixes `constant`'s ability to handle functions.https://docs.shadowtraffic.io/changelog/#073https://docs.shadowtraffic.io/changelog/#073Wed, 07 Aug 2024 17:47:04 GMT🎁 Adds new infix [`math`](/functions/math) function to make it easier to evaluate long, nested math expressions.https://docs.shadowtraffic.io/changelog/#072https://docs.shadowtraffic.io/changelog/#072Thu, 01 Aug 2024 18:35:01 GMT🐞 Fixes cases where the Kafka `io.shadowtraffic.kafka.serdes.JsonSerializer` may incorrectly serialize decimals values as literal ratios and produce incorrect JSON.https://docs.shadowtraffic.io/changelog/#071https://docs.shadowtraffic.io/changelog/#071Wed, 31 Jul 2024 15:30:44 GMT💪 Uncaps the throttle of the free trial for the first 5,000,000 generated events. This helps people assess ShadowTraffic's true performance firsthand before buying.https://docs.shadowtraffic.io/changelog/#070https://docs.shadowtraffic.io/changelog/#070Tue, 30 Jul 2024 20:47:33 GMT🎁 Adds [ShadowTraffic Studio](/studio), a light-weight, visual development tool for the browser.https://docs.shadowtraffic.io/changelog/#0612https://docs.shadowtraffic.io/changelog/#0612Thu, 18 Jul 2024 20:45:33 GMT🎁 Adds new [`pow`](/functions/pow) function.https://docs.shadowtraffic.io/changelog/#0611https://docs.shadowtraffic.io/changelog/#0611Thu, 18 Jul 2024 20:45:33 GMT🎁 Adds new optional `names` parameter to the [`string`](/functions/string) function, letting you scope identifiers that may be used within `expr`. 💪 Raises a better error when `iterateVars` names a non-existent variable.https://docs.shadowtraffic.io/changelog/#0610https://docs.shadowtraffic.io/changelog/#0610Tue, 16 Jul 2024 21:40:54 GMT🐞 Fixes `iterateVars` parameter of `repeatedly` to refresh variables in dependency order. 🐞 Fixes nested function call errors that could overlap each other and hide the real error message.https://docs.shadowtraffic.io/changelog/#069https://docs.shadowtraffic.io/changelog/#069Tue, 16 Jul 2024 18:52:08 GMT🐞 Fixes references to generators in schedule `stages` that terminate and are reused through a `lookup`. This previously caused a stacktrace, but is now fixed.https://docs.shadowtraffic.io/changelog/#068https://docs.shadowtraffic.io/changelog/#068Tue, 16 Jul 2024 18:11:29 GMT💪 Adds new `iterateVars` parameter to [`repeatedly`](/functions/repeatedly) so that element variable references can vary between elements.https://docs.shadowtraffic.io/changelog/#067https://docs.shadowtraffic.io/changelog/#067Tue, 16 Jul 2024 17:06:29 GMT💪 Allows `geolocation` to generate multiple formats per invocation.https://docs.shadowtraffic.io/changelog/#066https://docs.shadowtraffic.io/changelog/#066Mon, 15 Jul 2024 21:26:36 GMT💪 Adds jsonl as an output format for the file system connector.https://docs.shadowtraffic.io/changelog/#065https://docs.shadowtraffic.io/changelog/#065Fri, 12 Jul 2024 17:17:51 GMT🐞 Fixes drilling into `object` formatting with `path` for the `geolocation` function.https://docs.shadowtraffic.io/changelog/#064https://docs.shadowtraffic.io/changelog/#064Mon, 08 Jul 2024 17:50:45 GMT🐞 Fixes cosmetic dependency warning when using the Azure Blob Storage connection. The dependencies were always present, but not checkable through the approach Azure uses. This has been fixed.https://docs.shadowtraffic.io/changelog/#063https://docs.shadowtraffic.io/changelog/#063Mon, 01 Jul 2024 22:31:09 GMT💪 Adds new transformation parameters to the output of the [`string`](/functions/string) function.https://docs.shadowtraffic.io/changelog/#062https://docs.shadowtraffic.io/changelog/#062Mon, 01 Jul 2024 16:23:43 GMT🐞 Fixes bug where multiple generators on the filesystem connector would start their file suffixes at different numbers.https://docs.shadowtraffic.io/changelog/#061https://docs.shadowtraffic.io/changelog/#061Fri, 28 Jun 2024 21:40:29 GMT🎁 Adds [Azure Blob storage](/connections/azureBlobStorage) as a new connection type. 💪 Improves the error that gets emitted when ShadowTraffic tries to automatically generate a schema for a function whose type it can't infer. 💪 Improves the error that gets emitted when Avro serialization fails because of either missing fields or mistyped unions.https://docs.shadowtraffic.io/changelog/#060https://docs.shadowtraffic.io/changelog/#060Tue, 25 Jun 2024 20:44:05 GMT🎁 Adds new feature, `schedule`, that allows orchestrating when generators run. See [the overview](/overview#schedules), and reference sections for [`stages`](/schedule/stages) and [`loop`](/schedule/loop).https://docs.shadowtraffic.io/changelog/#0511https://docs.shadowtraffic.io/changelog/#0511Mon, 24 Jun 2024 19:24:09 GMT🎁 Adds support for headers in Kafka records. 🐞 Fixes bug where forks with state initialization wouldn't have access to variables. 💪 Prints better error message when `waypoints` receives coordinates that don't match expectations. 🙅 Removes the `number` function. This was added early on with a different API in mind. Use `uniformDistribution` or `normalDistribution` to generate floating point numbers instead.https://docs.shadowtraffic.io/changelog/#0510https://docs.shadowtraffic.io/changelog/#0510Fri, 21 Jun 2024 18:14:27 GMT🎁 Adds new `fileSystem` connection.https://docs.shadowtraffic.io/changelog/#059https://docs.shadowtraffic.io/changelog/#059Thu, 20 Jun 2024 16:36:11 GMT🎁 Adds new `maxMs` generator configuration to cap how long a generator may run for. 💪 Adds new `default` parameter to the `env` function for fallback values.https://docs.shadowtraffic.io/changelog/#058https://docs.shadowtraffic.io/changelog/#058Wed, 19 Jun 2024 17:25:27 GMT💪 Auto-creating Kafka topics will now use the broker default partition count and replication factor, instead of forcing `1` for both respectively.https://docs.shadowtraffic.io/changelog/#057https://docs.shadowtraffic.io/changelog/#057Thu, 13 Jun 2024 18:54:35 GMT🎁 Adds new `time` global configuration to override the starting wallclock time. 🎁 Adds new `timeMultiplier` global configuration to change the rate at which time advances.https://docs.shadowtraffic.io/changelog/#056https://docs.shadowtraffic.io/changelog/#056Wed, 12 Jun 2024 18:19:16 GMT💪 `loadJsonFile` and `env` now work recursively, meaning you can chain loaded files and nest environment variables within. 💪 `loadJsonFile`'s `data` parameter is now evaluated for other preprocessors, like `env`, before it executes.https://docs.shadowtraffic.io/changelog/#055https://docs.shadowtraffic.io/changelog/#055Tue, 11 Jun 2024 20:27:16 GMT🐞 Prevents raw stack trace from leaking out when state machines transition to a non-existent state. This now shows a helpful error message.https://docs.shadowtraffic.io/changelog/#054https://docs.shadowtraffic.io/changelog/#054Tue, 11 Jun 2024 19:35:21 GMT💪 Adds support for `eventId` in Event Store connections. 💪 Allows `eventType` to be the result of a function call in Event Store connections. 💪 Allows `eventType` to be overriden within a state machine in Event Store connections. 💪 Adds new optional `streamSuffix` to qualify Event Store stream names.https://docs.shadowtraffic.io/changelog/#053https://docs.shadowtraffic.io/changelog/#053Tue, 11 Jun 2024 17:35:13 GMT🎁 Adds new `throttleMs` generator configuration, which supercedes `throttle ms`. Same configuration, improved name. 🎁 Adds new `maxHistoryEvents` generator configuration, which supercedes `history events max`. Same configuration, improved name. 🙅 Removes the `integer` function, which was confusing. Superceded by the `decimals` function modifier, which when set to `0`, produces integers. 🙅 Removes the `degenerateDistribution` function, which was a redundant, more narrow version of the `constant` function.https://docs.shadowtraffic.io/changelog/#052https://docs.shadowtraffic.io/changelog/#052Tue, 11 Jun 2024 16:44:06 GMT🐞 Fixes automatic Avro schema creation for Kafka topics with a `-` in their name. Dashes are incompatible with Avro, so ShadowTraffic now replaces them with `_`.https://docs.shadowtraffic.io/changelog/#051https://docs.shadowtraffic.io/changelog/#051Mon, 10 Jun 2024 22:11:15 GMT🐞 Fixes `--watch` mode hanging when certain exceptions were thrown.https://docs.shadowtraffic.io/changelog/#050https://docs.shadowtraffic.io/changelog/#050Mon, 10 Jun 2024 20:35:14 GMT🎁 Allows `transitions` into `stateMachine` functions to be specified sequentially, allowing imperative walks through a set of states.https://docs.shadowtraffic.io/changelog/#0424https://docs.shadowtraffic.io/changelog/#0424Fri, 07 Jun 2024 21:19:50 GMT🐞 Fixes `oneOf` and `weightedOneOf` not passing up initialization from stateful functions. 💪 Loosens schema to allow `waypoints` to take dynamic coordinates.https://docs.shadowtraffic.io/changelog/#0423https://docs.shadowtraffic.io/changelog/#0423Thu, 06 Jun 2024 18:28:36 GMT🎁 Allows `metadata` to optionally be supplied for Event Store generators.https://docs.shadowtraffic.io/changelog/#0422https://docs.shadowtraffic.io/changelog/#0422Wed, 05 Jun 2024 18:38:19 GMT🐞 Fixes bug in `waypoints` where passing `speed` as a function threw an error.https://docs.shadowtraffic.io/changelog/#0421https://docs.shadowtraffic.io/changelog/#0421Wed, 05 Jun 2024 17:37:01 GMT🐞 Removes stray print output.https://docs.shadowtraffic.io/changelog/#0420https://docs.shadowtraffic.io/changelog/#0420Wed, 05 Jun 2024 16:38:23 GMT🎁 Adds new optional `data` parameter to `loadJsonFunction` to perform simple templating substitutions.https://docs.shadowtraffic.io/changelog/#0419https://docs.shadowtraffic.io/changelog/#0419Tue, 04 Jun 2024 22:30:58 GMT💪 Allows `trichotomy` bounds parameters to be function calls.https://docs.shadowtraffic.io/changelog/#0418https://docs.shadowtraffic.io/changelog/#0418Tue, 04 Jun 2024 21:25:12 GMT🎁 Adds new `trichotomy` math function.https://docs.shadowtraffic.io/changelog/#0417https://docs.shadowtraffic.io/changelog/#0417Tue, 04 Jun 2024 17:00:22 GMT💪 `--seed` now randomizes for each run when running with `--watch` instead of locking for the entire session.https://docs.shadowtraffic.io/changelog/#0416https://docs.shadowtraffic.io/changelog/#0416Fri, 31 May 2024 17:19:53 GMT🎁 Adds new `loadJsonFile` function to load configuration fragments from other files. 🎁 Adds new `cast` function modifier to cast values to/from strings. 🐞 Fixes static check for required properties on `digitString` and `characterString` functions.https://docs.shadowtraffic.io/changelog/#0415https://docs.shadowtraffic.io/changelog/#0415Thu, 30 May 2024 17:27:24 GMT🐞 Fixes bug where function calls may not get invoked through multiple vars / varsOnce call chains.https://docs.shadowtraffic.io/changelog/#0414https://docs.shadowtraffic.io/changelog/#0414Wed, 29 May 2024 16:17:47 GMT🐞 Fixes automatic schema creation for Postgres binary types. 🐞 Allows `bytes` function to generate zero length arrays. 🐞 Fixes `uniformDistribution` and `normalDistribution` parameters for very large numbers. 🐞 Fixes regression in `someKeys` not evaluating nested values. 💪 Allows `characterString` and `digitString` to generate varying sized text.https://docs.shadowtraffic.io/changelog/#0413https://docs.shadowtraffic.io/changelog/#0413Tue, 28 May 2024 20:31:43 GMT💪 Dramatically increases the performance of conditional generators like `oneOf` and `weightedOneOf`.https://docs.shadowtraffic.io/changelog/#0412https://docs.shadowtraffic.io/changelog/#0412Fri, 24 May 2024 21:20:59 GMT🎁 Adds automatic schema generation for the `waypoints` function. 💪 Prevents throttle from applying on terminal states of a state machine. Now, when the state machine is finished, the generator exits immediately.https://docs.shadowtraffic.io/changelog/#0411https://docs.shadowtraffic.io/changelog/#0411Thu, 23 May 2024 16:42:14 GMT🎁 Adds new `mask` parameter to the `env` function, which suppresses logging of sensitive environment variables.https://docs.shadowtraffic.io/changelog/#0410https://docs.shadowtraffic.io/changelog/#0410Thu, 23 May 2024 16:10:35 GMT🐞 Fixes bug where `--watch` wouldn't reset `--seed` to produce the same data each run. 🐞 Fixes bug where using forked generators and `--seed` might not produce the same data each run.https://docs.shadowtraffic.io/changelog/#049https://docs.shadowtraffic.io/changelog/#049Wed, 22 May 2024 22:27:25 GMT🐞 Fixes bug where functions in `globalConfigs` weren't referencable.https://docs.shadowtraffic.io/changelog/#048https://docs.shadowtraffic.io/changelog/#048Wed, 22 May 2024 21:57:24 GMT💪 Adds a new `tablePolicy` option to Postgres, `create`, and makes it the default. Prior to this release, ShadowTraffic would default to the `dropAndCreate` mode to truncate tables, which was overly destructive.https://docs.shadowtraffic.io/changelog/#047https://docs.shadowtraffic.io/changelog/#047Wed, 22 May 2024 18:03:39 GMT🎁 Permits `intervals` function to be used in any spot outside of data, including `throttle`.https://docs.shadowtraffic.io/changelog/#046https://docs.shadowtraffic.io/changelog/#046Mon, 20 May 2024 18:35:44 GMT💪 Fork keys powered by a lookup call now spawn forks in the order the original data was created. This behavior is far more intuitive as a default, especially for use cases that make a fork for each element in another data set.https://docs.shadowtraffic.io/changelog/#045https://docs.shadowtraffic.io/changelog/#045Mon, 20 May 2024 17:31:31 GMT💪 Further improves the efficiency that new forks are spawned, minimizing the work to find the next logical fork to launch.https://docs.shadowtraffic.io/changelog/#044https://docs.shadowtraffic.io/changelog/#044Fri, 17 May 2024 21:31:48 GMT💪 Improves the efficiency that new forks are spawned. Prior to this release, you'd see slight delays of forks producing output with the `--stdout` flag. These delays are no longer present.https://docs.shadowtraffic.io/changelog/#043https://docs.shadowtraffic.io/changelog/#043Fri, 17 May 2024 15:10:04 GMT🎁 Adds new `maxEvents` generator configuration, which supercedes `events exactly`. Same configuration, improved name.https://docs.shadowtraffic.io/changelog/#042https://docs.shadowtraffic.io/changelog/#042Thu, 16 May 2024 18:18:26 GMT💪 Permit variables in all spots of `waypoints`.https://docs.shadowtraffic.io/changelog/#041https://docs.shadowtraffic.io/changelog/#041Thu, 16 May 2024 17:45:54 GMT💪 Looses the schema for `waypoints` to permit coordinates from function calls.https://docs.shadowtraffic.io/changelog/#040https://docs.shadowtraffic.io/changelog/#040Thu, 16 May 2024 16:04:31 GMT⚠️ Changes the require path syntax for `lookup` calls against Postgres. Previously, `path` automatically prepended `"row"`, which was confusing and shortsighted. Now, it no longer prepends, giving you access to the entire geneerated event. Apologies for the breakage. 💪 Simplifies the `waypoints` function. Instead of having this function feed into `geoPosition`, it can now be used alone. 🙅 Removes the `geoPosition` function, according to the above. 🎁 Adds new `path` function modifier so that it can be applied to any function. 🎁 Adds new `decimals` function modifier so that it can be applied to any function.https://docs.shadowtraffic.io/changelog/#0323https://docs.shadowtraffic.io/changelog/#0323Wed, 15 May 2024 16:49:13 GMT🐞 Fixes bug where `lookup` functions inside of a variable against a fork would throw an exception.https://docs.shadowtraffic.io/changelog/#0322https://docs.shadowtraffic.io/changelog/#0322Tue, 14 May 2024 17:48:14 GMT🎁 Adds new `env` function to load environment variables.https://docs.shadowtraffic.io/changelog/#0321https://docs.shadowtraffic.io/changelog/#0321Mon, 13 May 2024 16:28:13 GMT💪 Kafka topic creation now behaves idempotently to prevent races between competing ShadowTraffic containers.https://docs.shadowtraffic.io/changelog/#0320https://docs.shadowtraffic.io/changelog/#0320Tue, 07 May 2024 15:25:25 GMT🎁 Adds new `bytes` function for controlling payload size.https://docs.shadowtraffic.io/changelog/#0319https://docs.shadowtraffic.io/changelog/#0319Fri, 03 May 2024 16:06:45 GMT🐞 Fixes an issue where forks with state machines that terminate wouldn't release their fork key.https://docs.shadowtraffic.io/changelog/#0318https://docs.shadowtraffic.io/changelog/#0318Mon, 29 Apr 2024 16:55:32 GMT💪 Adds a new optional `loop` parameter to the `waypoints` function, instructing it to travel an infinite loop around the defined coordinates.https://docs.shadowtraffic.io/changelog/#0317https://docs.shadowtraffic.io/changelog/#0317Fri, 26 Apr 2024 21:48:52 GMT🐞 Fixes bug where `null rate` could throw an error in nested generators.https://docs.shadowtraffic.io/changelog/#0316https://docs.shadowtraffic.io/changelog/#0316Fri, 26 Apr 2024 21:03:32 GMT💪 `geoPosition` and `geoWander` now include `heading` in the generated data to describe what direction the object is moving.https://docs.shadowtraffic.io/changelog/#0315https://docs.shadowtraffic.io/changelog/#0315Fri, 26 Apr 2024 20:04:04 GMT🐞 Fixes determinism when using seeded generation with `someKeys`. 💪 Reduces the overload of calling generators that perform a random-nth operation.https://docs.shadowtraffic.io/changelog/#0314https://docs.shadowtraffic.io/changelog/#0314Thu, 25 Apr 2024 18:42:46 GMT🎁 Top-level state machines can now merge their previously generated events, which is useful for modeling how an object changes over time.https://docs.shadowtraffic.io/changelog/#0313https://docs.shadowtraffic.io/changelog/#0313Thu, 18 Apr 2024 18:40:38 GMT🐞 Fixes bug in `waypoints` where multiple segments could become disjointed.https://docs.shadowtraffic.io/changelog/#0312https://docs.shadowtraffic.io/changelog/#0312Wed, 17 Apr 2024 18:41:42 GMT🙅 Removes CLI option `--show-progress`. Instead, use Prometheus metrics exposed on port `9400` to monitor generated events/s. 💪 Sets smaller Prometheus histogram buckets to discern how long each generator iteration takes.https://docs.shadowtraffic.io/changelog/#0311https://docs.shadowtraffic.io/changelog/#0311Wed, 17 Apr 2024 16:50:30 GMT🎁 Adds new experimental `geoWander`, `geoPosition`, and `waypoints` generators with the intent to deprecate the older geospatial functions. 🎁 Adds new `selectKeys` option to gran a subset of keys from an object.https://docs.shadowtraffic.io/changelog/#0310https://docs.shadowtraffic.io/changelog/#0310Tue, 16 Apr 2024 21:18:13 GMT🐞 Fixes double serialization of records with Kafka JSON Schema serializer.https://docs.shadowtraffic.io/changelog/#039https://docs.shadowtraffic.io/changelog/#039Mon, 15 Apr 2024 21:44:53 GMT🎁 Adds `endpoint` option for `connectionConfigs` to S3 connection to make it possible to connect to MinIO and similiar S3-compatible systems.https://docs.shadowtraffic.io/changelog/#038https://docs.shadowtraffic.io/changelog/#038Mon, 15 Apr 2024 16:31:39 GMT🎁 Adds localConfigs options `kafkaKeyAvroSchemaHint` and `kafkaValueAvroSchemaHint` so you can manually supply Kafka Avro schemas. This is useful if your schema is hard to infer, or the inference doesn't guess it correctly.https://docs.shadowtraffic.io/changelog/#037https://docs.shadowtraffic.io/changelog/#037Mon, 15 Apr 2024 15:04:58 GMT💪 Dramatically improves performance for deeply nested generators. 🐞 Fixes fractional throttle values.https://docs.shadowtraffic.io/changelog/#036https://docs.shadowtraffic.io/changelog/#036Thu, 11 Apr 2024 21:06:53 GMT🐞 **Critical**: Fixes a memory leak where `fork` and `lookup` interact across generators. 💪 Optimizes memory footprint by no longer storing history for generators that don't service `lookup`s.https://docs.shadowtraffic.io/changelog/#035https://docs.shadowtraffic.io/changelog/#035Wed, 10 Apr 2024 20:56:12 GMT🎁 Introduces Prometheus metrics to observe how ShadowTraffic is performing.https://docs.shadowtraffic.io/changelog/#034https://docs.shadowtraffic.io/changelog/#034Fri, 05 Apr 2024 20:47:22 GMT🐞 Fixes `heading` calculation formula.https://docs.shadowtraffic.io/changelog/#033https://docs.shadowtraffic.io/changelog/#033Thu, 04 Apr 2024 20:44:30 GMT🎁 Adds new `keyNames` option to rename keys from any generators that return objects. 🎁 Adds new `heading` function to calculate direction in degrees.https://docs.shadowtraffic.io/changelog/#032https://docs.shadowtraffic.io/changelog/#032Thu, 04 Apr 2024 17:31:25 GMT🐞 Fixes step size bug in `geospatialPathScheme` function. 🐞 Fixes radians bug in `geospatialPathScheme` function.https://docs.shadowtraffic.io/changelog/#031https://docs.shadowtraffic.io/changelog/#031Wed, 03 Apr 2024 21:01:10 GMT💪 Relaxes restriction on all `path` arguements requiring at least one element. It can now take zero elements to access the object directly.https://docs.shadowtraffic.io/changelog/#030https://docs.shadowtraffic.io/changelog/#030Wed, 03 Apr 2024 20:48:13 GMT🎁 Adds new experimental connection type to EventStore.https://docs.shadowtraffic.io/changelog/#027https://docs.shadowtraffic.io/changelog/#027Wed, 03 Apr 2024 18:06:03 GMT🎁 Adds new `pgHint` generator option for explicitly defining how Postgres columns get created.https://docs.shadowtraffic.io/changelog/#026https://docs.shadowtraffic.io/changelog/#026Tue, 02 Apr 2024 22:24:36 GMT🐞 Fixes bug where Postgres table isn't auto created correctly with UUIDs.https://docs.shadowtraffic.io/changelog/#025https://docs.shadowtraffic.io/changelog/#025Thu, 28 Mar 2024 15:43:05 GMT🎁 Introduces new `geolocation` generator. 🐞 Fixes race condition where dynamic JSON Schema classes didn't always load on time. 🐞 Fixes bug where local generator overrides for Kafka producer configuration didn't work. 🐞 Fixes bug where Postgres tables weren't always correctly created with certain column types. 🎁 Adds a utility `JsonDeserializer` class.https://docs.shadowtraffic.io/changelog/#024https://docs.shadowtraffic.io/changelog/#024Thu, 21 Mar 2024 19:21:34 GMT🙅 Remove debug statement.https://docs.shadowtraffic.io/changelog/#023https://docs.shadowtraffic.io/changelog/#023Thu, 21 Mar 2024 18:14:48 GMT🐞 Fixes bug where an automatically generated Avro schema would be incorrect for nested records.https://docs.shadowtraffic.io/changelog/#022https://docs.shadowtraffic.io/changelog/#022Wed, 20 Mar 2024 22:12:03 GMT💪 Relaxes schema of `uniformDistribution` to be a double, not an integer.https://docs.shadowtraffic.io/changelog/#021https://docs.shadowtraffic.io/changelog/#021Wed, 20 Mar 2024 18:49:52 GMT🙅 Removes extraneous information from being written to S3 bucket.https://docs.shadowtraffic.io/changelog/#020https://docs.shadowtraffic.io/changelog/#020Wed, 20 Mar 2024 18:30:15 GMT🎁 Added new connection type - `s3` - for Amazon S3 endpoints.https://docs.shadowtraffic.io/changelog/#0136https://docs.shadowtraffic.io/changelog/#0136Mon, 18 Mar 2024 16:40:38 GMT🐞 Fixed bug where inferring an Avro schema on a forked lookup would throw an error. 💪 Made the `uuid` generator compatible with all string serializers.https://docs.shadowtraffic.io/changelog/#0135https://docs.shadowtraffic.io/changelog/#0135Tue, 12 Mar 2024 16:38:43 GMT🎁 Added new mode for Kafka `topicPolicy` - `create`, and switched it to be the default to prevent surprising behavior.https://docs.shadowtraffic.io/changelog/#0134https://docs.shadowtraffic.io/changelog/#0134Mon, 11 Mar 2024 18:32:44 GMT🎁 Added new `topicPolicy` to Kafka connection map, with the default to auto-create non-existent topics (and drop/recreate them otherwise). This makes it easier to iterate on data generators without having to flip back and forth between ShadowTraffic and Kafka. 💪 Updated default Postgres behavior for `tablePolicy` from `manual` to `dropAndCreate`, for the same reason as Kafka.https://docs.shadowtraffic.io/changelog/#0133https://docs.shadowtraffic.io/changelog/#0133Mon, 11 Mar 2024 16:22:35 GMT🐞 Fixed bug in Avro serialization where `oneOf` / `weightedOneOf` could cause problems with type unions.https://docs.shadowtraffic.io/changelog/#0132https://docs.shadowtraffic.io/changelog/#0132Fri, 08 Mar 2024 18:00:49 GMT🐞 Fixed bug where forking could incorrectly raise an uncaught exception.https://docs.shadowtraffic.io/changelog/#0131https://docs.shadowtraffic.io/changelog/#0131Mon, 04 Mar 2024 18:37:34 GMT🐞 Fixed erroneous exception thrown when looking up data across two forked generators.https://docs.shadowtraffic.io/changelog/#0130https://docs.shadowtraffic.io/changelog/#0130Mon, 04 Mar 2024 17:48:00 GMT🐞 Fixed a case where runtime exceptions print a poor error message.https://docs.shadowtraffic.io/changelog/#0129https://docs.shadowtraffic.io/changelog/#0129Fri, 23 Feb 2024 16:58:10 GMT🐞 Fixed a critical bug with the Postgres connection type that prevented `lookup` generators from working correctly.https://docs.shadowtraffic.io/changelog/#0128https://docs.shadowtraffic.io/changelog/#0128Thu, 22 Feb 2024 18:56:22 GMT💪 Loosened configuration validation for Kafka serializers to permit custom serializers. See the Kafka reference docs for instructions. 🙅 Removed Kafka XML serializer - instead, use a custom serializer.https://docs.shadowtraffic.io/changelog/#0127https://docs.shadowtraffic.io/changelog/#0127Tue, 20 Feb 2024 21:23:32 GMT🐞 Fixed generated Avro types for some dynamically-typed generators like map, merge, etc.https://docs.shadowtraffic.io/changelog/#0126https://docs.shadowtraffic.io/changelog/#0126Tue, 20 Feb 2024 21:11:06 GMT🎁 Added support for Confluent Avro Schema Registry integration. ShadowTraffic now infers the Avro schema of your data, then registers or updates the remote schema.https://docs.shadowtraffic.io/changelog/#0125https://docs.shadowtraffic.io/changelog/#0125Tue, 20 Feb 2024 19:52:40 GMT🎁 Added optional unit to geospatial functions. Default is radians, but may use degrees.https://docs.shadowtraffic.io/changelog/#0124https://docs.shadowtraffic.io/changelog/#0124Tue, 20 Feb 2024 18:31:01 GMT💪 Loosens schema for `throttle ms` and `stagger ms`, permitting not just integers, but now doubles. This is useful to apply throttling, but still allow > 10K events/second to be generated.https://docs.shadowtraffic.io/changelog/#0123https://docs.shadowtraffic.io/changelog/#0123🎁 Adds new `decimals` option to `uniformDistribution` and `normalDistribution` generators to limit the number of decimal places.https://docs.shadowtraffic.io/changelog/#0122https://docs.shadowtraffic.io/changelog/#0122🎁 Adds new `constant` generator to return known values, which is useful for adding `null` and `elide` parameters.https://docs.shadowtraffic.io/changelog/#0121https://docs.shadowtraffic.io/changelog/#0121🎁 Adds new `elide` generator option to periodically elide a key from a map.https://docs.shadowtraffic.io/changelog/#0120https://docs.shadowtraffic.io/changelog/#0120🎁 Adds new `map` function to generate key/value pairs.https://docs.shadowtraffic.io/changelog/#0119https://docs.shadowtraffic.io/changelog/#0119🐞 Fixes Confluent JSON Schema serializer integration. https://docs.shadowtraffic.io/changelog/#0118https://docs.shadowtraffic.io/changelog/#0118🐞 Fixes edge cases communicating with the TimePlus API.https://docs.shadowtraffic.io/changelog/#0117https://docs.shadowtraffic.io/changelog/#0117🐞 Fixes Proton and TimePlus dependency chain.https://docs.shadowtraffic.io/changelog/#0116https://docs.shadowtraffic.io/changelog/#0116🐞 Fixes Proton and TimePlus lookup generator calls.https://docs.shadowtraffic.io/changelog/#0115https://docs.shadowtraffic.io/changelog/#0115🎁 Added new experimental Proton and TimePlus connections.https://docs.shadowtraffic.io/changelog/#0114https://docs.shadowtraffic.io/changelog/#0114🎁 Added new `tablePolicy` for Postgres connections. Set to value `dropAndCreate` to automatically create target tables if they don't exist. Default is `manual`, which leaves it to you to create the tables.https://docs.shadowtraffic.io/changelog/#0113https://docs.shadowtraffic.io/changelog/#0113🎁 Added new `digitString` and `characterString` functions to do fast random alphanumeric generation.https://docs.shadowtraffic.io/changelog/#0112https://docs.shadowtraffic.io/changelog/#0112🎁 Added new `op` attribute to Postgres generators, allowing updates and deletes, not just inserts.https://docs.shadowtraffic.io/changelog/#0111https://docs.shadowtraffic.io/changelog/#0111🐞 Fixed bug in how CLI errors are printed.https://docs.shadowtraffic.io/changelog/#0110https://docs.shadowtraffic.io/changelog/#0110🎁 Added new command line switch `--config-base64` to accept base64 encoded literal representations of configuration files, which is useful for programmatically working with ShadowTraffic.https://docs.shadowtraffic.io/changelog/#019https://docs.shadowtraffic.io/changelog/#019🎁 Added new `io.shadowtraffic.kafka.serdes.XmlSerializer` Kafka serde.https://docs.shadowtraffic.io/changelog/#018https://docs.shadowtraffic.io/changelog/#018🐞 Fixed bug where non-string variables couldn't be referenced in `string` exprs.https://docs.shadowtraffic.io/changelog/#017https://docs.shadowtraffic.io/changelog/#017🎁 `string` calls can now reference variables. Variables will attempt to be resolved before any Java Faker invocations.https://docs.shadowtraffic.io/changelog/#016https://docs.shadowtraffic.io/changelog/#016🎁 Added `--seed` flag to enable repeatable runs. The only things not repeatable are calls to the current wallclock time with `now` and Java Faker's `Internet.uuid` generator, which can't be overriden. For repeatable UUIDs, use the `uuid` generator.https://docs.shadowtraffic.io/changelog/#015https://docs.shadowtraffic.io/changelog/#015💪 Improved error messages when on bad Java Faker expressions. Now links to the docs with the list of valid exprs.https://docs.shadowtraffic.io/changelog/#014https://docs.shadowtraffic.io/changelog/#014🐞 Fixed bad build - changes from 0.1.3 appear here, not previous version.https://docs.shadowtraffic.io/changelog/#013https://docs.shadowtraffic.io/changelog/#013💪 Improved runtime error messages to show all raw and evaluated local values.https://docs.shadowtraffic.io/changelog/#012https://docs.shadowtraffic.io/changelog/#012🐞 Fixed bug allowing multiple forks to concurrently run under the same forkKey.https://docs.shadowtraffic.io/changelog/#011https://docs.shadowtraffic.io/changelog/#011🐞 Fixed bug that sometimes transitioned state machines to a null state.https://docs.shadowtraffic.io/changelog/#010https://docs.shadowtraffic.io/changelog/#010🙅 Removed `for` in `stateMachine`, superseded by `fork` (see below). 🙅 Removed `stringSeries` call, superseded by `sequentialString`. 🎁 Added `sequentialString` call to mirror behavior of `sequentialInteger`. 🎁 Added motion calls: `geospatialPathScheme` and `geospatialPath`. 🎁 Added new feature `fork` to dynamically create new generators. 🎁 Added new feature `varsOnce` to lock variable definitions for the lifetime of a generator.https://docs.shadowtraffic.io/changelog/#0041https://docs.shadowtraffic.io/changelog/#0041🎁 Added support for Kafka sasl mechanism `SCRAM-SHA-512`.https://docs.shadowtraffic.io/changelog/#0040https://docs.shadowtraffic.io/changelog/#0040🎁 Added support for Kafka sasl mechanism `SCRAM-SHA-256`.https://docs.shadowtraffic.io/changelog/#0039https://docs.shadowtraffic.io/changelog/#0039💪 Dramatically improved performance to all backends by a factor of 20-30x. 🎁 Added new `delay` configuration option.https://docs.shadowtraffic.io/changelog/#0038https://docs.shadowtraffic.io/changelog/#0038🐞 Fixed a bug causing an evaluation error using `oneOf` when `choices` is supplied a generator.https://docs.shadowtraffic.io/changelog/#0037https://docs.shadowtraffic.io/changelog/#0037🎁 Added new `repeat` local and global configuration options to generate an event multiple times.https://docs.shadowtraffic.io/changelog/#0036https://docs.shadowtraffic.io/changelog/#0036💪 Improved error message when supplying an invalid license expiration date.https://docs.shadowtraffic.io/changelog/#0035https://docs.shadowtraffic.io/changelog/#0035🎁 Added static error handling when trying to reference an undefined var.https://docs.shadowtraffic.io/changelog/#0034https://docs.shadowtraffic.io/changelog/#0034🎁 Introduced `discard` local and global configuration option. 🐞 Fixed eager evaluation of `oneOf` and `weightedOneOf` parameters.