-
motoko (
moc
)- bugfix: Corrects the interpreter (and compiler) to recognise certain type parameters as callable function types (#4617).
-
motoko (
moc
)-
deprecation: Deprecate the use of base library's
ExperimentalStableMemory
(ESM) (#4573). Newmoc
flag--experimental-stable-memory <n>
controls the level of deprecation:- n < 0: error on use of stable memory primitives.
- n = 0: warn on use of stable memory primitives.
- n > 1: warning-less use of stable memory primitives (for legacy applications).
Users of ESM should consider migrating their code to use isolated regions (library
Region.mo
) instead.
-
bugfix: Fix the detection of unused declarations in
switch
andcatch
alternatives (#4560). -
improvement: Only warn on unused identifiers if type checking is error-free (#4561).
-
-
motoko (
moc
)-
feat: Custom error message for unused, punned field bindings (#4454).
-
feat: Don't report top-level identifiers as unused (#4452).
-
bugfix: Declaring
<system, ...>
capability on a class enables system capabilities in its body (#4449). -
bugfix: Fix crash compiling actor reference containing an
await
(#4418, #4450). -
bugfix: Fix crash when compiling with flag
--experimental-rtti
(#4434).
-
-
motoko (
moc
)-
Warn on detection of unused identifiers (code
M0194
) (#4377).- By design, warnings are not emitted for code imported from a package.
- A warning can be suppressed by replacing the identifier entirely by a wildcard
_
, or by prefixing it with an_
, e.g. replacex
by_x
.
Limitations: recursive and mutually recursive definitions are considered used, even if never referenced outside the recursive definition.
-
Remove
__get_candid_interface_tmp_hack
endpoint. Candid interface is already stored as canister metadata, this temporary endpoint is redundant, thus removed. (#4386) -
Improved capability system, introducing a synchronous (
system
) capability (#4406).actor
initialisation body,pre
/postupgrade
hooks,async
function bodies (and blocks) possess this capability. Functions (and classes) can demand it by prependingsystem
to the type argument list. The capability can be forwarded in calls by mentioning<system, …>
in the instantiation parameter list.BREAKING CHANGE (Minor): A few built-in functions have been marked with demand for the
system
capability. In order to call these, the full call hierarchy needs to be adapted to pass thesystem
capability. -
Introduced the feature for precise tagging of scalar values (#4369).
Controlled by flag
--experimental-rtti
(off by default). Minor performance changes for arithmetic expected. We advise to only turn on the feature for testing, as currently no productive upsides exist (though future improvements will depend on it), and performance of arithmetic will degrade somewhat. See the PR for the whole picture.
-
-
motoko-base
- Added
Option.equal
function (thanks to ByronBecker) (dfinity/motoko-base#615).
- Added
-
motoko (
moc
)-
Officializing the new incremental garbage collector after a successful beta testing phase. The incremental GC can be enabled by the
moc
flag--incremental-gc
(#3837) and is designed to scale for large program heap sizes.Note: While resolving scalability issues with regard to the instruction limit of the GC work, it is now possible to hit other scalability limits:
- Out of memory: A program can run out of memory if it fills the entire memory space with live objects.
- Upgrade limits: When using stable variables, the current mechanism of serialization and deserialization to and from stable memory can exceed the instruction limit or run out of memory.
Recommendations:
- Test the upgrade: Thoroughly test the upgrade mechanism for different data volumes and heap sizes and conservatively determine the amount of stable data that is supported when upgrading the program.
- Monitor the heap size: Monitor the memory and heap size (
Prim.rts_memory_size()
andPrim.rts_heap_size()
) of the application in production. - Limit the heap size: Implement a custom limit in the application to keep the heap size and data volume below the scalability limit that has been determined during testing, in particular for the upgrade mechanism.
- Avoid large allocations per message: Avoid large allocations of 100 MB or more per message, but rather distribute larger allocations across multiple messages. Large allocations per message extend the duration of the GC increment. Moreover, memory pressure may occur because the GC has a higher reclamation latency than a classical stop-the-world collector.
- Consider a backup query function: Depending on the application case, it can be beneficial to offer an privileged query function to extract the critical canister state in several chunks. The runtime system maintains an extra memory reserve for query functions. Of course, such a function has to be implemented with a check that restricts it to authorized callers only. It is also important to test this function well.
- Last resort if memory would be full: Assuming the memory is full with objects that have shortly become garbage before the memory space has been exhausted, the canister owner or controllers can call the system-level function
__motoko_gc_trigger()
multiple times to run extra GC increments and complete a GC run, for collecting the latest garbage in a full heap. Up to 100 calls of this function may be needed to complete a GC run in a 4GB memory space. The GC keeps an specific memory reserve to be able to perform its work even if the application has exhausted the memory. Usually, this functionality is not needed in practice but is only useful in such exceptional cases.
-
Allow type annotations on free-standing
object
/module
/actor
blocks, in order to perform a conformity check with an interface type (#4324).
-
-
motoko (
moc
)-
Include doc comments to Candid interfaces generated via the
--idl
flag (#4334). -
bugfix: fix broken implementations of
Region.loadNat32
,Region.storeNat32
,Region.loadInt32
,Region.storeInt32
(#4335). Values previously stored with the broken 32-bit operations must be loaded with care. If bit 0 is clear, the original value can be obtained by an arithmetic shift right by 1 bit. If bit 0 is set, the value cannot be trusted and should be ignored (it encodes some transient address of a boxed value).
-
-
motoko-base
-
Added
ExperimentalInternetComputer.performanceCounter
function to get the raw performance counters (dfinity/motoko-base#600). -
Added
Array.take
function to get some prefix of an array (dfinity/motoko-base#587). -
Deprecated
TrieSet.mem
in favor ofTrieSet.has
(dfinity/motoko-base#576). -
bugfix:
Array.chain(as, f)
was incorrectly trapping whenf(a)
was an empty array (dfinity/motoko-base#599).
-
-
motoko (
moc
)-
bugfix: separate tag from underscore in coverage warnings (#4274).
-
Code compiled for targets WASI (
-wasi-system-api
) and pure Wasm (-no-system-api
) can now use up to 4GB of (efficiently emulated) stable memory, enabling more offline testing of, for example, stable data structures built using librariesRegions.mo
andExperimentalStableMemory.mo
. Note that any Wasm engine (such aswasmtime
), used to execute such binaries, must support and enable Wasm featuresmulti-memory
andbulk-memory
(as well as the standard NaN canonicalization) (#4256). -
bugfix: fully implement
Region.loadXXX/storeXXX
forInt8
,Int16
andFloat
(#4270). -
BREAKING CHANGE (Minor): values of type
Principal
are now constrained to contain at most 29 bytes, matching the IC's notion of principal (#4268).In particular:
-
An actor
import
will be statically rejected if the binary representation of the (aliased) textually encoded principal contains strictly more than 29 bytes. -
Principal.fromBlob(b)
will trap ifb
contains strictly more than 29 bytes. -
The actor literal,
actor <exp>
, will trap if the binary representation of of the textually encoded principal<exp>
contains strictly more than 29 bytes.
-
-
-
motoko-base
- bugfix: fix
Array.tabulateVar
to avoid repeated side-effects (dfinity/motoko-base#596)
- bugfix: fix
-
motoko (
moc
)-
bugfix: fix assertion failure renaming
or
-patterns (#4236, #4224). -
bugfix: unsuccessful Candid decoding of an optional array now defaults to null instead of crashing (#4240).
-
bugfix: Candid decoding of an optional, unknown variant with a payload now succeeds instead of crashing (#4238).
-
Implement Prim.textLowercase and Prim.textUppercase (via Rust) (#4216).
-
perf: inline sharable low-level functions in generated coded, trading code size for reduced cycle count (#4212). Controlled by flags:
-fno-shared-code
(default)-fshared-code
(legacy) (Helps mitigate the effect of the IC's new cost model, that increases the cost of function calls).
-
-
motoko-base
-
Added
Principal.toLedgerAccount
(dfinity/motoko-base#582). -
Added
Text.toLowercase
andText.toUppercase
(dfinity/motoko-base#590).
-
-
motoko (
moc
)-
Added a new stable
Region
type of dynamically allocated, independently growable and isolated regions of IC stable memory (#3768). See documentation. BREAKING CHANGE: stable memory changes may occur that can prevent returning to previousmoc
versions. -
Added doc comments in generated Candid files (#4178).
-
-
motoko-base
-
Exposed conversions between adjacent fixed-width types (dfinity/motoko-base#585).
-
Added library
Region.mo
offering isolated regions of IC stable memory (dfinity/motoko-base#580).
-
-
motoko (
moc
)-
Added numerical type conversions between adjacent fixed-width types (#4139).
-
Administrative: legacy-named release artefacts are no longer created (#4111).
-
-
motoko (
moc
)-
Performance improvement: lower the default allocation for bignums (#4102).
-
Performance improvement: generate better code for pattern matches on some small variants (#4093).
-
bugfix: don't crash on import of Candid composite queries (#4128).
-
-
motoko (
moc
)-
Allow canister controllers to call the
__motoko_stable_var_info
query endpoint (#4103). (Previously only self-queries were permitted.) -
Performance improvement: reduced cycle consumption for allocating objects (#4095).
-
bugfix: reduced memory consumption in the Motoko Playground (#4106).
-
-
motoko (
moc
)-
Allow identifiers in
or
-patterns (#3807). Bindings in alternatives must mention the same identifiers and have compatible types:let verbose = switch result { case (#ok) "All is good!"; case (#warning why or #error why) "There is some problem: " # why; }
-
Performance improvement: improved cycle consumption allocating fixed-size objects (#4064). Benchmarks indicate up to 10% less cycles burned for allocation-heavy code, and 2.5% savings in realistic applications.
-
Administrative: binary build artefacts are now available according to standard naming conventions (thanks to EnzoPlayer0ne) (#3997). Please consider transitioning to downloading binaries following the new scheme, as legacy naming will be discontinued at some point in the future.
-
-
motoko (
moc
)-
Allow multiline text literals (#3995). For example,
"A horse walks into a bar. The barman says: `Why the long face?`"
parses as:
"A horse walks into a bar.\nThe barman says: `Why the long face?`"
-
Added pipe operator
<exp1> |> <exp2>
and placeholder expression_
(#3987). For example:Iter.range(0, 10) |> Iter.toList _ |> List.filter<Nat>(_, func n { n % 3 == 0 }) |> { multiples = _ };
may, according to taste, be a more readable rendition of:
{ multiples = List.filter<Nat>( Iter.toList(Iter.range(0, 10)), func n { n % 3 == 0 }) };
However, beware the change of evaluation order for code with side-effects.
-
BREAKING CHANGE (Minor):
New keyword
composite
allows one to declare Internet Computer composite queries (#4003).For example,
public shared composite query func sum(counters : [Counter]) : async Nat { var sum = 0; for (counter in counters.vals()) { sum += await counter.peek(); }; sum }
has type:
shared composite query [Counter] -> async Nat
and can call both
query
and othercomposite query
functions.See the documentation for full details.
-
Allow canister imports of Candid service constructors, ignoring the service arguments to import the instantiated service instead (with a warning) (#4041).
-
Allow optional terminal semicolons in Candid imports (#4042).
-
bugfix: allow signed float literals as static expressions in modules (#4063).
-
bugfix: improved reporting of patterns with record types in error messages (#4002).
-
-
motoko-base
- Added more
Array
(andText
) utility functions (thanks to roman-kashitsyn) (dfinity/motoko-base#564).
- Added more
-
motoko (
moc
)- Added fields
sender_canister_version
for actor class version tracking (#4036).
- Added fields
-
motoko (
moc
)-
BREAKING CHANGE (Minor):
or
-patterns in function definitions cannot be inferred any more. The new error message suggests to add a type annotation instead. This became necessary in order to avoid potentially unsound types (#4012). -
Added implementation for
ic0.canister_version
as a primitive (#4027). -
Added a more efficient
Prim.blobCompare
(thanks to nomeata) (#4009). -
bugfix: minor error in grammar for
async*
expressions (#4005).
-
-
motoko-base
- Add
Principal.isController
function (dfinity/motoko-base#558).
- Add
-
motoko (
moc
)-
Added implementation for
ic0.is_controller
as a primitive (#3935). -
Added ability to enable the new incremental GC in the Motoko Playground (#3976).
-
-
motoko (
moc
)-
For beta testing: Add a new incremental GC, enabled with new moc flag
--incremental-gc
(#3837). The incremental garbage collector is designed to scale for large program heap sizes.The GC distributes its workload across multiple steps, called increments, that each pause the mutator (user's program) for only a limited amount of time. As a result, the GC work can fit within the instruction-limited IC messages, regardless of the heap size and the object structures.
According to GC benchmark measurements, the incremental GC is more efficient than the existing copying, compacting, and generational GC in the following regards:
- Scalability: Able to use the full heap space, 3x more object allocations on average.
- Shorter interruptions: The GC pause has a maximum limit that is up to 10x shorter.
- Lower runtimes: The number of executed instructions is reduced by 10% on average (compared to the copying GC).
- Less GC overhead: The amount of GC work in proportion to the user's program work drops by 10-16%.
The GC incurs a moderate memory overhead: The allocated WASM memory has been measured to be 9% higher on average compared to the copying GC, which is the current default GC.
To activate the incremental GC under
dfx
, the following command-line argument needs to be specified indfx.json
:... "type" : "motoko" ... "args" : "--incremental-gc" ...
-
bugfix:
array.vals()
now returns a working iterator for mutable arrays (#3497, #3967).
-
-
motoko (
moc
)- Performance improvement: optimised code generation for pattern matching that cannot fail (#3957).
-
motoko (
moc
)-
Added ability to
mo-doc
for rendering documentation of nested modules (#3918). -
bugfix: when re-adding recurrent timers, skip over past expirations (#3871).
-
bugfix: eliminated crash compiling local
async
functions that pattern match on arguments (#3910, #3916).
-
-
motoko (
moc
)-
bugfix: avoid compiler crash (regression) when
let
-matching on constant variants (#3901, #3903). -
Performance improvement: improved cycle usage when receiving messages (#3893).
-
-
motoko (
moc
)-
Performance improvement: Values of variant type that are compile-time known are relegated to the static heap now and don't get allocated each time (#3878).
-
bugfix: the global timer expiration callback was called unnecessarily in the default mechanism (#3883).
-
-
motoko (
moc
)-
Performance improvement: UTF-8 coding and validation is now properly tail recursive (#3842).
-
Performance improvement: eliminated bounds checking for certain array accesses (thanks to nomeata) (#3853).
-
Performance improvement: optimized
{array, blob, text}.size()
operations (thanks to nomeata) (#3863). -
Performance improvement: efficient tuple results in
switch
statements (thanks to nomeata) (#3865). -
Performance improvement: more efficient untagging operation (#3873).
-
bugfix: restored a grammar regression caused by
let-else
(#3869).
-
-
motoko-base
-
Add
Array.subArray
function (dfinity/motoko-base#445). -
BREAKING CHANGE (Minor)
Optimized
AssocList.{replace, find}
to avoid unnecessary allocation (dfinity/motoko-base#535, dfinity/motoko-base#539). Note: this subtly changes the order in which the key-value pairs occur after replacement. May affect other containers that useAssocList
. -
Performance improvement: Optimized deletion for
Trie
/TrieMap
(dfinity/motoko-base#525).
-
-
motoko (
moc
)-
new 'let-else' construct for handling pattern-match failure (#3836). This is a frequently asked-for feature that allows to change the control-flow of programs when pattern-match failure occurs, thus providing a means against the famous "pyramid of doom" issue. A common example is look-ups:
shared func getUser(user : Text) : async Id { let ?id = Map.get(users, user) else { throw Error.reject("no such user") }; id }
Similarly, an expression like
(label v : Bool { let <pat> = <exp> else break v false; true })
evaluates to a
Bool
, signifying whether<pat>
matches<exp>
. -
Improve recursive deserialization capacity to match recursive serialization capacity by reducing Wasm stack consumption (#3809). Because of the bounds on recursion depth imposed by fixed-size stack, the advice remains the same: avoid deeply nested recursive data structures. Think "shallow trees good, very long lists bad".
-
bugfix: stack overflow in UTF-8 encode/decode for
moc.js
(#3825).
-
-
motoko-base
- add missing
unshare : Tree<K, V> -> ()
method to classRBTree<K, V>
to restore objects from saved state (dfinity/motoko-base#532).
- add missing
-
motoko (
moc
)-
Add compiler flag
--rts-stack-pages <n>
to override default number of pages dedicated to fixed runtime system stack. Now defaults to 32 pages (2MiB) (up from previous 2 pages/128KiB) (#3782). In emergencies, increasing this setting may improve your ability to deserialize deeply nested Candid or stable variable data. -
Add stack overflow detection utilising reserved page (#3793).
-
Performance improvement: heap allocator speedup (#3090, #3790).
-
bugfix: avoid more heap-out-bounds errors during deserialization of stable variables by increasing default runtime system stack from 128KiB to 2MiB (#3782). Note: this is a partial fix, as issues with stack growth remain.
-
-
motoko-base
- bugfix: non-leaky deletion for
RBTree
(dfinity/motoko-base#524).
- bugfix: non-leaky deletion for
-
motoko (
moc
)-
Performance improvement: faster heap allocation (#3765).
-
bugfix:
async
returns involving abbreviated tuple types no longer crash the compiler (#3740, #3741). -
bugfix: avoid quadratic code expansion due to imported, but unused, actor classes (#3758).
-
-
motoko (
moc
)-
BREAKING CHANGE
Motoko now implements Candid 1.4 (dfinity/candid#311).
In particular, when deserializing an actor or function reference, Motoko will now first check that the type of the deserialized reference is a subtype of the expected type and act accordingly.
Very few users should be affected by this change in behaviour.
-
BREAKING CHANGE
Failure to send a message no longer traps but, instead, throws a catchable
Error
with new error code#call_error
(#3630).On the IC, the act of making a call to a canister function can fail, so that the call cannot (and will not be) performed. This can happen due to a lack of canister resources, typically because the local message queue for the destination canister is full, or because performing the call would reduce the current cycle balance of the calling canister to a level below its freezing threshold. Such call failures are now reported by throwing an
Error
with newErrorCode
#call_error { err_code = n }
, wheren
is the non-zeroerr_code
value returned by the IC. Like other errors, call errors can be caught and handled usingtry ... catch ...
expressions, if desired.The constructs that now throw call errors, instead of trapping as with previous version of Motoko are:
- calls to
shared
functions (including oneway functions that return()
). These involve sending a message to another canister, and can fail when the queue for the destination canister is full. - calls to local functions with return type
async
. These involve sending a message to self, and can fail when the local queue for sends to self is full. async
expressions. These involve sending a message to self, and can fail when the local queue for sends to self is full.await
expressions. These can fail on awaiting an already completed future, which requires sending a message to self to suspend and commit state.
(On the other hand,
async*
(being delayed) cannot throw, and evaluatingawait*
will at most propagate an error from its argument but not, in itself, throw.)Note that exiting a function call via an uncaught throw, rather than a trap, will commit any state changes and currently queued messages. The previous behaviour of trapping would, instead, discard, such changes.
To appreciate the change in semantics, consider the following example:
actor { var count = 0; public func inc() : async () { count += 1; }; public func repeat() : async () { loop { ignore inc(); } }; public func repeatUntil() : async () { try { loop { ignore inc(); } } catch (e) { } }; }
In previous releases of Motoko, calling
repeat()
andrepeatUntil()
would trap, leavingcount
at0
, because each infinite loop would eventually exhaust the message queue and issue a trap, rolling back the effects of each call. With this release of Motoko, callingrepeat()
will enqueue severalinc()
messages (around 500), thenthrow
anError
and exit with the error result, incrementing thecount
several times (asynchronously). CallingrepeatUntil()
will also enqueue severalinc()
messages (around 500) but the error is caught so the call returns, still incrementingcount
several times (asynchronously).The previous semantics of trapping on call errors can be enabled with compiler option
--trap-on-call-error
, if desired, or selectively emulated by forcing a trap (e.g.assert false
) when an error is caught.For example,
public func allOrNothing() : async () { try { loop { ignore inc(); } } catch (e) { assert false; // trap! } };
Calling
allOrNothing()
will not send any messages: the loop exits with an error on queue full, the error is caught, butassert false
traps so all queuedinc()
messages are aborted. - calls to
-
bugfix: system method
inspect
involving message with single tuple argument no longer crashes the compiler (#3732, #3733).
-
-
motoko (
moc
)-
Added support for
ManagementCanister.raw_rand
in interpreters (#3693). -
Added preliminary Viper support for
old
expressions in specifications and calls to private methods (#3675). -
bugfix: in the default timer mechanism
cancelTimer
sometimes wouldn't actually stop a recurring timer (#3695). -
bugfix: zero negation for floating point numbers in compiled code (#3676).
-
-
motoko-base
-
Add user-facing timer functionality (dfinity/motoko-base#474).
-
Add
Array.size
(dfinity/motoko-base#486, dfinity/motoko-base#494). -
Add
TrieSet
methodsisEmpty
,isSubset
(dfinity/motoko-base#503). -
BREAKING CHANGES (Minor):
- renamed
Float.neq
toFloat.neg
(this was a misspelling) - renamed
Nat.neq
toNat.neg
(this was a misspelling) - removed second argument from
bitnot
(this was an oversight)
- renamed
-
bugfix:
Random.Finite.coin
didn't use entropy correctly (dfinity/motoko-base#500). -
bugfix:
Trie.mergeDisjoint
(dfinity/motoko-base#505). -
bugfix:
TrieSet.equals
(dfinity/motoko-base#503). -
Various documentation fixes and API usage examples.
-
-
motoko (
moc
)-
Add new primitives for a default timer mechanism (#3542). These are
setTimer : (delayNanos : Nat64, recurring : Bool, job : () -> async ()) -> (id : Nat) cancelTimer : (id : Nat) -> ()
By defining a
system func timer
the default mechanism can now be overridden by a custom implementation. Additionally by supplying the command-line flag-no-timer
all aspects of timers can be suppressed, e.g. for space- or security-sensitive purposes, thus effectively reverting canisters to the pre-timers era. -
bugfix: silence bogus cascading errors in stable compatibility check (#3645).
-
-
motoko (
moc
)-
Add new keywords
async*
andawait*
(note the*
) for efficient abstraction of asynchronous code (#3609).<typ> ::= ... async* <typ> delayed, asynchronous computation <exp> ::= ... async* <block-or-exp> delay an asynchronous computation await* <block-or-exp> execute a delayed computation (only in async, async*)
This avoids the resource consumption and latency of
async
/await
by only committing state and suspending execution when necessary in theawait*
-ed computation, not necessarily at theawait*
itself.WARNING: Unlike
async
/await
:- an
async*
value has no effect unlessawait*
-ed; - each
await*
of the sameasync*
value repeats its effects.
This feature is experimental and may evolve in future. Use with discretion. See the manual for details.
- an
-
Suppress GC during IC
canister_heartbeat
, deferring any GC to the scheduled Motokoheartbeat
system
method (#3623). This is a temporary workaround, to be removed once DTS is supported forcanister_heartbeat
itself (#3622). -
Add a new generational GC, enabled with new moc flag
--generational-gc
(#3495). The generational garbage collector optimizes for fast reclamation of short-lived objects. New objects are allocated in a young generation that is more frequently collected than the older objects that have already survived a GC run.For many cases, the generational GC is more efficient than the existing compacting GC and copying GCs:
- Lower runtimes: Less number of executed instructions on average.
- Shorter interruptions: Young generation collection entails shorter program interruptions.
To activate the generational GC under
dfx
, the following command-line argument needs to be specified indfx.json
:... "type" : "motoko" ... "args" : "--generational-gc" ...
-
moc.js
: add trampoline and step limiter to interpreter, avoiding (some) stackoverflows and hangs (#3618, #3541). Enables execution of larger examples on web pages. -
BREAKING CHANGE (Minor):
Consider records with mutable fields as non-static (#3586). Consequently, an imported library declaring a mutable record is now rejected, not accepted, to be consistent with the declarations of mutable fields and mutable objects.
-
Experimental Viper integration by compiling a very narrow subset of Motoko to the verification intermediate language. See
src/viper/README.md
and the PR for details. (#3477).
-
-
motoko-base
-
Unit tests for Trie and fix for
disj
(dfinity/motoko-base#438). -
Respect Trie structure in
filter
(dfinity/motoko-base#431, dfinity/motoko-base#438). -
Array module reimplementation, tests and documentation (dfinity/motoko-base#425,dfinity/motoko-base#432).
-
-
motoko (
moc
)-
Statically reject shared functions and function types with type parameters (#3519, #3522).
-
Performance improvement:
Array.init
andArray.tabulate
(#3526).
-
-
motoko-base
-
Add some examples to
Buffer
library documentation (dfinity/motoko-base#420). -
Fix another bug in
Buffer
library affectingfilterEntries
(dfinity/motoko-base#422).
-
-
motoko-base
- Fix bugs in
Buffer
library affectingremove
andfilterEntries
(dfinity/motoko-base#419).
- Fix bugs in
-
motoko (
moc
)-
Halve (default ir-checking) compilation times by optimizing type comparison and hashing (#3463)
-
Add support for type components in object type syntax (#3457, also fixes #3449)
type Record = { type T = Nat; x : Nat};
is now legal. Note the definition of
T
is neither recursive, nor bound inx : Nat
, but can refer to an existing recursive type declared in an outer scope. -
-
motoko-base
- Optimized and extended
Buffer
library (dfinity/motoko-base#417).
- Optimized and extended
-
motoko (
moc
)-
BREAKING CHANGE (Minor): Adds new syntax for merging records (objects) and adding/overwriting fields. The expression
{ baseA and baseB with field1 = val1; field2 = val2 }
creates a new record by joining all (statically known) fields from
baseA/B
and the explicitly specifiedfield1/2
. This is a breaking change, as a new keywordwith
has been added. Restrictions for ambiguous andvar
fields from bases apply. (#3084) -
Add new support for installing actor class instances on the IC, enabling specification of canister settings, install, upgrade and reinstall. (#3386)
A new expression
(system <exp> . <id>)
where
<exp>
is an imported library and<id>
is the name of an actor class, accesses a secondary constructor of the class that takes an additional argument controlling the installation.For example,
await (system Lib.Node)(#upgrade a)(i);
upgrades actor
a
with the code for a new instance of classLib.Node
, passing constructor argument(i)
. -
Performance improvements for assigment-heavy code (thanks to nomeata) (#3406)
-
-
motoko (
moc
)-
add primitives
shiftLeft : (Nat, Nat32) -> Nat shiftRight : (Nat, Nat32) -> Nat
for efficiently multiplying/dividing a
Nat
by a power of 2 (#3112) -
add primitives
rts_mutator_instructions : () -> Nat rts_collector_instructions : () -> Nat
to report approximate IC instruction costs of the last message due to mutation (computation) and collection (GC), respectively (#3381)
-
-
motoko-base
-
Add
Buffer.fromArray Buffer.fromVarArray
for efficiently adding an array to a
Buffer
(dfinity/motoko-base#389) -
Add
Iter.sort : (xs : Iter<A>, compare : (A, A) -> Order) : Iter<A>
for sorting an
Iter
given a comparison function (dfinity/motoko-base#406) -
Performance:
HashMap
now avoids re-computing hashes onresize
(dfinity/motoko-base#394)
-
-
motoko (
moc
)- The language server now supports explicit symbol imports (thanks to rvanasa) (#3282)
- The language server now has improved support for navigating to definitions in external modules (thanks to rvanasa) (#3263)
- Added a primitive
textCompare
allowing more efficient three-wayText
comparisons (#3298) - Fixed a typing bug with annotated, recursive records (#3268)
-
motoko-base
-
Add
ExperimentalInternetComputer.countInstruction : (comp : () -> ()) -> Nat64
to count the Wasm instructions performed during execution of
comp()
(dfinity/motoko-base#381) -
Add
ExperimentalStableMemory.stableVarQuery : () -> (shared query () -> async {size : Nat64})
for estimating stable variable storage requirements during upgrade (dfinity/motoko-base#365)
-
Performance improvement to
Text.compare
(dfinity/motoko-base#382)
-
-
motoko (
moc
)- Add
to_candid
,from_candid
language constructs for Candid serialization to/from Blobs (#3155) - New
system
field 'inspect' for accepting/declining canister ingress messages (see doc) (#3210)
- Add
-
motoko (
moc
)- Importing modules by relative path is now more robust (#3215).
- Performance: persisting stable variables to stable memory is now performed in streaming fashion, reducing heap consumption and copying during an upgrade (#3149).
- Performance: local 32- and 64-bit numeric values are now stored in using unboxed form when possible (thanks to nomeata) (#3207).
-
motoko-base
- Fixed a bug in
Trie.filter
(andTrie.mapFilter
) which could lead to missing matches in some cases (dfinity/motoko-base#371).
- Fixed a bug in
-
motoko (
moc
)- Performance: inline prim-wrapping functions (thanks to nomeata) (#3159)
- Improve type pretty printer to mirror type parser (avoids producing unparseable stable variable signatures) (#3190)
- Adds new flag
--omit-metadata
to omit certain metadata sections fromactor
(andactor class
) Wasm (#3164) - Performance: avoid redundant heap allocation when deserializing compact Candid
int
andnat
values (#3173) - Added a primitive to obtain stable variable memory footprint (#3049)
-
motoko-base
- Fixed the 32-bit range limitation of
Hash.hash: Nat -> Nat32
and deprecate most functions inHash
(dfinity/motoko-base#366). - Add
List.toIter
(thanks to hoosan) (dfinity/motoko-base#336).
- Fixed the 32-bit range limitation of
-
motoko (
moc
)- bugfix: fix bogus elision of type constructors sharing names with primitive types in
--stable-types
section and.most
file (#3140)
- bugfix: fix bogus elision of type constructors sharing names with primitive types in
-
motoko (
moc
)- bugfix: fix bogus identification of distinct type constructors in --stable-types section and .most file (#3140)
-
motoko (
moc
)-
bugfix: fix pretty printing of (stable) types and #3128 (#3130)
- Collect constructors transitively before emitting a .most file.
- Modifies type pretty printer to produce well-formed types and stable type signatures.
-
-
motoko (
moc
)- Fix: remove bogus error when transitively importing module with selective field imports (#3121)
- Fix: Treating eponymous types from separate candid files (#3103)
-
Various reports from CI are now pushed to https://dfinity.github.io/motoko (#3113)
-
motoko (
moc
)- Emit new ICP metadata custom section 'motoko:compiler' with compiler release or revision in UTF8 (e.g. "0.6.21"). Default is
icp:private
(#3091). - Generalized
import
supporting pattern matching and selective field imports (#3076). - Fix: insert critical overflow checks preventing rare heap corruptions in out-of-memory allocation and stable variable serialization (#3077).
- Implement support for 128-bit Cycles-API (#3042).
- Emit new ICP metadata custom section 'motoko:compiler' with compiler release or revision in UTF8 (e.g. "0.6.21"). Default is
-
motoko-base
ExperimentalInternetComputer
library, exposing low-level, binarycall
function (a.k.a. "raw calls") (dfinity/motoko-base#334, Motoko #3806).Principal.fromBlob
added (dfinity/motoko-base#331).
-
motoko
- Implement support for
heartbeat
system methods (thanks to ninegua) (#2971)
- Implement support for
-
motoko-base
- Add
Iter.filter : <A>(Iter<A>, A -> Bool) -> Iter<A>
(thanks to jzxchiang1) (dfinity/motoko-base#328).
- Add
-
motoko-base
- Fixed a bug in the
RBTree.size()
method.
- Fixed a bug in the
-
moc
- Add runtime support for low-level, direct access to 64-bit IC stable memory, including documentation.
- Add compiler flag
--max-stable-pages <n>
to cap any use ofExperimentalStableMemory.mo
(see below), while reserving space for stable variables. Defaults to 65536 (4GiB).
-
motoko-base
- (Officially) add
ExperimentalStableMemory.mo
library, exposing 64-bit IC stable memory
- (Officially) add
-
BREAKING CHANGE (Minor): The previously available (but unadvertised)
ExperimentalStableMemory.mo
usedNat32
offsets. This one usesNat64
offsets to (eventually) provide access to more address space.
- Improved handling of one-shot messages facilitating zero-downtime upgrades (#2938).
- Further performance improvements to the mark-compact garbage collector (#2952, #2973).
- Stable variable checking for
moc.js
(#2969). - A bug was fixed in the scoping checker (#2977).
- Minor performance improvement to the mark-compact garbage collector
- Fixes crash when (ill-typed)
switch
expression on non-variant value has variant alternatives (#2934)
-
The compiler now embeds the existing Candid interface and new stable signature of a canister in additional Wasm custom sections, to be selectively exposed by the IC, and to be used by tools such as
dfx
to verify upgrade compatibility (see extended documentation).New compiler options:
--public-metadata <name>
: emit ICP custom section<name>
(candid:args
orcandid:service
ormotoko:stable-types
) aspublic
(default isprivate
)--stable-types
: emit signature of stable types to.most
file--stable-compatible <pre> <post>
: test upgrade compatibility between stable-type signatures<pre>
and<post>
A Motoko canister upgrade is safe provided:
- the canister's Candid interface evolves to a Candid subtype; and
- the canister's Motoko stable signature evolves to a stable-compatible one.
(Candid subtyping can be verified using tool
didc
available at: https://github.com/dfinity/candid.) -
BREAKING CHANGE (Minor): Tightened typing for type-annotated patterns (including function parameters) to prevent some cases of unintended and counter-intuitive type propagation.
This may break some rare programs that were accidentally relying on that propagation. For example, the indexing
xs[i]
in the following snippet happend to type-check before, becausei
was given the more precise typeNat
(inferred fromrun
's parameter type), regardless of the overly liberal declaration as anInt
:func run(f : Nat -> Text) {...}; let xs = ["a", "b", "c"]; run(func(i : Int) { xs[i] });
This no longer works,
i
has to be declared asNat
(or the type omitted).If you encounter such cases, please adjust the type annotation.
-
Improved garbage collection scheduling
-
Miscellaneous performance improvements
- code generation for
for
-loops over arrays has improved - slightly sped up
Int
equality comparisons
- code generation for
Pulled
-
for
loops over arrays are now converted to more efficient index-based iteration (#2831). This can result in significant cycle savings for tight loops, as well as slightly less memory usage. -
Add type union and intersection. The type expression
T and U
produces the greatest lower bound of types
T
andU
, that is, the greatest type that is a subtype of both. Dually,T or U
produces the least upper bound of types
T
andU
, that is, the smallest type that is a supertype of both.One use case of the former is "extending" an existing object type:
type Person = {name : Text; address : Text}; type Manager = Person and {underlings : [Person]};
Similarly, the latter can be used to "extend" a variant type:
type Workday = {#mon; #tue; #wed; #thu; #fri}; type Weekday = Workday or {#sat; #sun};
- Assertion error messages are now reproducible (#2821)
-
moc
- documentation changes
-
motoko-base
- documentation changes
-
motoko-base
- add Debug.trap : Text -> None (dfinity/motoko-base#288)
- Introduce primitives for
Int
⇔Float
conversions (#2733) - Bump LLVM toolchain to version 12 (#2542)
- Support extended name linker sections (#2760)
- Fix crashing bug for formatting huge floats (#2737)
-
moc
- Optimize field access by exploiting field ordering (#2708)
- Fix handling of self references in mark-compact GC (#2721)
- Restore CI reporting of perf-regressions (#2643)
-
motoko-base:
- Fix bug in
AssocList.diff
(dfinity/motoko-base#277) - Deprecate unsafe or redundant functions in library
Option
(unwrap
,assertSome
,assertNull
) (#275)
- Fix bug in
-
Vastly improved garbage collection scheduling: previously Motoko runtime would do GC after every update message. We now schedule a GC when
- Heap grows more than 50% and 10 MiB since the last GC, or
- Heap size is more than 3 GiB
(1) is to make sure we don't do GC on tiny heaps or after only small amounts of allocation. (2) is to make sure that on large heaps we will have enough allocation space during the next message.
This scheduling reduces cycles substantially, but may moderately increase memory usage.
New flag
--force-gc
restores the old behavior. -
Fix bug in compacting gc causing unnecessary memory growth (#2673)
-
Trap on attempt to upgrade when canister not stopped and there are outstanding callbacks. (This failure mode can be avoided by stopping the canister before upgrade.)
-
Fix issue #2640 (leaked
ClosureTable
entry when awaiting futures fails).
-
Add alternative, compacting gc, enabled with new moc flag
--compacting-gc
. The compacting gc supports larger heap sizes than the default, 2-space copying collector.NOTE: Dfx 0.7.6 adds optional field
"args"
todfx.json
files, so Motoko canisters can specifymoc
command-line arguments. E.g.,... "type" : "motoko" ... "args" : "--compacting-gc" ...
-
Documentation fixes.
-
Command line tools:
--help
option provides better documentation of command line options that have arguments. -
Fix issue #2319 (crash on import of Candid class).
-
For release builds, the banner (
moc --version
) now includes the release version. -
Fix MacOS release builds (the 0.6.3 tarball for MacOS contained the linux binaries)
-
Motoko is now open source!
-
Better internal consistency checking of the intermediate representation
-
motoko-base:
- reformat to style guidelines
- add type bindings
Nat.Nat
,Nat8.Nat8
etc. to libraries for primitive types.
-
Bugfix: generation of candid from Motoko:
- no longer confused by distinct, but eponymous, type definitions (Bug: #2529);
- numbers eponymous types and specializations from 1 (not 2);
- avoids long chains of type equalities by normalizing before translation.
- Internal: Update to IC interface spec 0.17 (adapt to breaking change to signature of
create_canister
)
-
BREAKING CHANGE: The old-style object and block syntax deprecated in 0.5.0 is finally removed.
-
Record punning: As already supported in patterns, short object syntax in expressions now allows omitting the right-hand side if it is an identifier of the same name as the label. That is,
{a; b = 1; var c}
is short for
{a = a; b = 1; var c = c}
assuming respective variables are in scope.
-
BREAKING CHANGE: The types
Word8
,Word16
,Word32
andWord64
have been removed. This also removed theblob.bytes()
iterator.Motoko base also dropped the
Word8
,Word16
,Word32
andWord64
modules.This concludes the transition to the other fixed-width types that began with version 0.5.8
-
BREAKING CHANGE (Minor):
await
on a completed future now also commits state and suspends computation, to ensure every await, regardless of its future's state, is a commit point for state changes and tentative message sends.(Previously, only awaits on pending futures would force a commit and suspend, while awaits on completed futures would continue execution without an incremental commit, trading safety for speed.)
-
motoko-base: fixed bug in
Text.compareWith
.
- Bugfix:
Blob.toArray
was broken.
-
BREAKING CHANGE (Minor): Type parameter inference will no longer default under-constrained type parameters that are invariant in the result, but require an explicit type argument. This is to avoid confusing the user by inferring non-principal types.
For example, given (invariant) class
Box<A>
:class Box<A>(a : A) { public var value = a; };
the code
let box = Box(0); // rejected
is rejected as ambiguous and requires an instantiation, type annotation or expected type. For example:
let box1 = Box<Int>(0); // accepted let box2 : Box<Nat> = Box(0); // accepted
Note that types
Box<Int>
andBox<Nat>
are unrelated by subtyping, so neither is best (or principal) in the ambiguous, rejected case. -
Bugfix: Type components in objects/actors/modules correctly ignored when involved in serialization, equality and
debug_show
, preventing the compiler from crashing. -
motoko-base: The
Text.hash
function was changed to a better one. If you stored hashes as stable values (which you really shouldn't!) you must rehash after upgrading. -
motoko-base: Conversion functions between
Blob
and[Nat8]
are provided. -
When the compiler itself crashes, it will now ask the user to report the backtrace at the DFINITY forum
-
The
moc
interpreter now pretty-prints values (as well as types) in the repl, producing more readable output for larger values. -
The family of
Word
types are deprecated, and mentioning them produces a warning. These type will be removed completely in a subsequent release. See the user’s guide, section “Word types”, for a migration guide. -
motoko base: because of this deprecation, the
Char.from/toWord32()
functions are removed. Migrate away fromWord
types, or useWord32.from/ToChar
for now.
-
The
moc
compiler now pretty-prints types in error messages and the repl, producing more readable output for larger types. -
motoko base: fixed bug in
Text.mo
affecting partial matches in, for example,Text.replace
(GH issue #234).
-
The
moc
compiler no longer rejects occurrences of private or local type definitions in public interfaces.For example,
module { type List = ?(Nat, List); // private public func cons(n : Nat, l : List) : List { ?(n , l) }; }
is now accepted, despite
List
being private and appearing in the type of public membercons
. -
Type propagation for binary operators has been improved. If the type of one of the operands can be determined locally, then the other operand is checked against that expected type. This should help avoiding tedious type annotations in many cases of literals, e.g.,
x == 0
or2 * x
, whenx
has a special type likeNat8
. -
The
moc
compiler now rejects type definitions that are non-productive (to ensure termination).For example, problematic types such as:
type C = C; type D<T, U> = D<U, T>; type E<T> = F<T>; type F<T> = E<T>; type G<T> = Fst<G<T>, Any>;
are now rejected.
-
motoko base:
Text
now containsdecodeUtf8
andencodeUtf8
.
-
User defined deprecations
Declarations in modules can now be annotated with a deprecation comment, which make the compiler emit warnings on usage.
This lets library authors warn about future breaking changes:
As an example:
module { /// @deprecated Use `bar` instead public func foo() {} public func bar() {} }
will emit a warning whenever
foo
is used. -
The
moc
compiler now rejects type definitions that are expansive, to help ensure termination. For example, problematic types such astype Seq<T> = ?(T, Seq<[T]>)
are rejected. -
motoko base:
Time.Time
is now public
-
The
moc
compiler now accepts the-Werror
flag to turn warnings into errors. -
The language server now returns documentation comments alongside completions and hover notifications
-
Wrapping arithmetic and bit-wise operations on
NatN
andIntN
The conventional arithmetic operators on
NatN
andIntN
trap on overflow. If wrap-around semantics is desired, the operators+%
,-%
,*%
and**%
can be used. The corresponding assignment operators (+%=
etc.) are also available.Likewise, the bit fiddling operators (
&
,|
,^
,<<
,>>
,<<>
,<>>
etc.) are now also available onNatN
andIntN
. The right shift operator (>>
) is an unsigned right shift onNatN
and a signed right shift onIntN
; the+>>
operator is not available on these types.The motivation for this change is to eventually deprecate and remove the
WordN
types.Therefore, the wrapping arithmetic operations on
WordN
are deprecated and their use will print a warning. See the user’s guide, section “Word types”, for a migration guide. -
For values
x
of typeBlob
, an iterator over the elements of the blobx.vals()
is introduced. It works likex.bytes()
, but returns the elements as typeNat8
. -
mo-doc
now generates cross-references for types in signatures in both the Html as well as the Asciidoc output. So a signature likefromIter : I.Iter<Nat> -> List.List<Nat>
will now let you click onI.Iter
orList.List
and take you to their definitions. -
Bugfix: Certain ill-typed object literals are now prevented by the type checker.
-
Bugfix: Avoid compiler aborting when object literals have more fields than their type expects.
- The type checker now exploits the expected type, if any,
when typing object literal expressions.
So
{ x = 0 } : { x : Nat8 }
now works as expected instead of requiring an additional type annotation on0
.
- The compiler now reports errors and warnings with an additional error code
This code can be used to look up a more detailed description for a given error by passing the
--explain
flag with a code to the compiler. As of now this isn't going to work for most codes because the detailed descriptions still have to be written. - Internal: The parts of the RTS that were written in C have been ported to Rust.
- new
moc
command-line arguments--args <file>
and--args0 <file>
for reading newline/NUL terminated arguments from<file>
. - motoko base: documentation examples are executable in the browser
-
Option blocks
do ? <block>
and option checks<exp> !
. Inside an option block, an option check validates that its operand expression is notnull
. If it is, the entire option block is aborted and evaluates tonull
. This simplifies consecutive null handling by avoiding verboseswitch
expressions.For example, the expression
do? { f(x!, y!) + z!.a }
evaluates tonull
if eitherx
,y
orz
isnull
; otherwise, it takes the options' contents and ultimately returns?r
, wherer
is the result of the addition. -
BREAKING CHANGE (Minor): The light-weight
do <exp>
form of the recently added, more generaldo <block-or-exp>
form, is no longer legal syntax. That is, the argument to ado
ordo ?
expression must be a block{ ... }
, never a simple expression.
- Nothing new, just release moc.js to CDN
- Bugfix: gracefully handle importing ill-typed actor classes
-
BREAKING CHANGE: Simple object literals of the form
{a = foo(); b = bar()}
no longer bind the field names locally. This enables writing expressions likefunc foo(a : Nat) { return {x = x} }
.However, this breaks expressions like
{a = 1; b = a + 1}
. Such object shorthands now have to be written differently, e.g., with an auxiliary declaration, as inlet a = 1; {a = a; b = a + 1}
, or by using the "long" object syntaxobject {public let a = 1; public let b = a + 1}
.
-
BREAKING CHANGE: Free-standing blocks are disallowed
Blocks are only allowed as sub-expressions of control flow expressions like
if
,loop
,case
, etc. In all other places, braces are always considered to start an object literal.To use blocks in other positions, the new
do <block>
expression can be used.The more liberal syntax is still allowed for now but deprecated, i.e., produces a warning.
-
BREAKING CHANGE: actor creation is regarded as asynchronous:
- Actor declarations are asynchronous and can only be used in asynchronous contexts.
- The return type of an actor class, if specified, must be an async actor type.
- To support actor declaration, the top-level context of an interpreted program is an asynchronous context, allowing implicit and explicit await expressions.
(Though breaking, this change mostly affects interpreted programs and compiled programs with explicate actor class return types)
-
Candid support is updated to latest changes of the Candid spec, in particular the ability to extend function with optional parameters in a backward compatible way.
Motoko passes the official Candid compliance test suite.
-
RTS: Injecting a value into an option type (
? <exp>
) no longer requires heap allocation in most cases. This removes the memory-tax of using iterators. -
Bugfix: Passing cycles to the instantiation of an actor class works now.
-
Various bug fixes and documentation improvements.
- Significant documentation improvements
- Various bugfixes
- Improved error messages
- Initial DWARF support
- Candid compliance improvements:
- Strict checking of utf8 strings
- More liberal parsing of leb128-encoded numbers
- New motoko-base:
- The Random library is added
- BREAKING CHANGE: a library containing a single actor class is imported as a module, providing access to both the class type and class constructor function as module components. Restores the invariant that imported libraries are modules.
- Backend: Compile captured actor class parameters statically (#2022)
- flip the default for -g (#1546)
- Bug fix: reject array indexing as non-static (could trap) (#2011)
- Initialize tuple length fields (#1992)
- Warns for structural equality on abstract types (#1972)
- Funds Imperative API (#1922)
- Restrict subtyping (#1970)
- Continue labels always have unit codomain (#1975)
- Compile.ml: target and use new builder call pattern (#1974)
- fix scope var bugs (#1973)
- Actor class export
- Accept unit installation args for actors
- Reject platform actor (class) programs with additional decs
- Handle IO exceptions at the top-level
- RTS: Remove duplicate array and blob allocation code
- RTS: Fix pointer arithmetic in BigInt collection function
- Preliminary support for actor class import and dynamic canister installation. Surface syntax may change in future.
- BREAKING CHANGE: a compilation unit/file defining an actor or actor class may only have leading
import
declarations; other leading declarations (e.g.let
ortype
) are no longer supported. - Rust GC
- Polymorphic equality.
==
and!=
now work on all shareable types.
- Switching to bumping the third component of the version number
- Bugfix: clashing declarations via function and class caught (#1756)
- Bugfix: Candid
bool
decoding rejects invalid input (#1783) - Canisters can take installation arguments (#1809) NB: Communicating the type of the canister installation methods is still missing.
- Optimization: Handling of
Bool
in the backend.
- Candid pretty printer to use shorthand when possible (#1774)
- fix candid import to use the new id format (#1787)
- Fixes an issue with boolean encoding to Candid
- Converts the style guide to asciidocs
- The
Blob
type round-trips through candid type export/import (#1744) - Allow actor classes to know the caller of their constructor (#1737)
- Internals:
Prim.time()
provided (#1747) - Performance: More dead code removal (#1752)
- Performance: More efficient arithmetic with unboxed values (#1693, #1757)
- Canister references are now parsed and printed according to the new base32-based textual format (#1732).
- The runtime is now embedded into
moc
and need not be distributed separately (#1772)
- Beginning of the changelog. Released with dfx-0.6.0.