diff options
74 files changed, 2747 insertions, 872 deletions
diff --git a/OTP_VERSION b/OTP_VERSION index 84a941394a..70a91e23ec 100644 --- a/OTP_VERSION +++ b/OTP_VERSION @@ -1 +1 @@ -22.0.7 +22.1 diff --git a/erts/doc/src/notes.xml b/erts/doc/src/notes.xml index 5ca387ffd8..6bc242c246 100644 --- a/erts/doc/src/notes.xml +++ b/erts/doc/src/notes.xml @@ -31,6 +31,331 @@ </header> <p>This document describes the changes made to the ERTS application.</p> +<section><title>Erts 10.5</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + If you set <c>{linger,{true,0}}</c> on a <c>gen_tcp</c> + listen socket, accept a connection on that socket, and + then close the accepted socket, now the linger zero + setting is transferred to the accepted socket. Before + this correction that information was lost and the close + behaviour on the accepted socket incorrect.</p> + <p> + Own Id: OTP-15370 Aux Id: ERIERL-353 </p> + </item> + <item> + <p> + Sending ancillary data implemented in OTP-15747 + accidentally left behind test code that caused all UDP + sends to fail on Windows. This has now been fixed.</p> + <p> + Own Id: OTP-15422 Aux Id: OTP-15747 </p> + </item> + <item> + <p> + In the socket nif, used invalid flags when if-def'ing for + supported TCP flags: TCP_MAXSEG and TCP_NODELAY (the + support function).</p> + <p> + Own Id: OTP-15827</p> + </item> + <item> + <p> + Fixed memory leaks in experimental socket module.</p> + <p> + Own Id: OTP-15830</p> + </item> + <item> + <p> + <c>re:run()</c> now yields when validating utf8 in a + large subject.</p> + <p> + Own Id: OTP-15836 Aux Id: ERL-876 </p> + </item> + <item> + <p> + Fixed bug in <c>seq_trace:set_token(label,Term)</c> which + could cause VM crash if <c>Term</c> was heap allocated + (not an atom, small integer, local pid or port). Bug + exists since OTP 21.0 when terms other than small + integers were first allowed as labels.</p> + <p> + Own Id: OTP-15849 Aux Id: ERL-700 </p> + </item> + <item> + <p> + Extra <c>-mode</c> flags given to <c>erl</c> are ignored + with a warning.</p> + <p> + Own Id: OTP-15852</p> + </item> + <item> + <p> + Don't loop indefinitely when <c>--enable-pgo</c> is given + to configure, but compiler does not support pgo.</p> + <p> + Own Id: OTP-15853 Aux Id: PR-2254 </p> + </item> + <item> + <p> + Fix <c>seq_trace:print/2</c> not to raise <c>badarg</c> + exception if label is not a small integer. Bug exists + since OTP 21.0.</p> + <p> + Own Id: OTP-15859 Aux Id: ERL-700 </p> + </item> + <item> + <p> + Fixed hipe_flush_icache_range for non-Linux OS on ARM.</p> + <p> + Own Id: OTP-15874 Aux Id: ERL-958, PR-2266 </p> + </item> + <item> + <p>The fix in OTP-15871 was too conservative and disabled + the offending load-time optimization in some cases where + it was safe.</p> + <p> + Own Id: OTP-15881</p> + </item> + <item> + <p> + Upgraded the ERTS internal PCRE library from version 8.42 + to version 8.43. See <url + href="http://pcre.org/original/changelog.txt">http://pcre.org/original/changelog.txt</url> + for information about changes made to PCRE. This library + implements major parts of the <seealso + marker="stdlib:re"><c>re</c></seealso> regular + expressions module.</p> + <p> + Own Id: OTP-15889</p> + </item> + <item> + <p> + Fix race condition when closing a socket while using + <c>{active,N}</c> on Windows.</p> + <p> + Own Id: OTP-15901 Aux Id: ERL-960 PR-2272 </p> + </item> + <item> + <p> + Allow more than one <c>-config</c> command line option to + <c>erl</c> on Windows to conform with other OS.</p> + <p> + Own Id: OTP-15918 Aux Id: ERL-912 </p> + </item> + <item> + <p> + Fix so that ERL_FLAGS environment variable does not + interfere with command line arguments. Before this fix + you could write:</p> + <p> + <c>ERL_FLAGS="10" erl +S</c></p> + <p> + and erlang would start as if <c>+S</c> had been given the + argument <c>10</c>.</p> + <p> + Own Id: OTP-15931</p> + </item> + <item> + <p> + The bug with ID ERL-717 has been fixed. The functions + <c>io:columns()</c> and <c>io:rows()</c> only worked + correctly inside interactive erlang shells before this + fix. These functions returned <c>{error,enotsup}</c> + before this fix even if stdout and stdin were connected + to a terminal when they were invoked from an escript or a + program started with e.g., <c>erl -noshell</c>.</p> + <p> + Own Id: OTP-15959 Aux Id: ERL-717 </p> + </item> + <item> + <p> + Do not use named label in <c>ethread.c</c> inline + assemble. This allows erts to be compiled using gcc 9.1.0 + with LTO enabled.</p> + <p> + Own Id: OTP-15971 Aux Id: PR-2333 </p> + </item> + <item> + <p><c>erlang:fun_to_list/1</c> will now escape the module + and function name when necessary.</p> + <p> + Own Id: OTP-15975 Aux Id: ERL-1009 </p> + </item> + <item> + <p><c>process_info(P,binary)</c> would neglect to look + through heap fragments, potentially missing a few + binaries associated with the process.</p> + <p> + Own Id: OTP-15978 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> + HiPE is now automatically disabled on systems with + non-glibc implementation (for instance musl). This is + because musl does not provide the API's for guaranteeing + that signals are delivered on the correct native stack.</p> + <p> + Own Id: OTP-16037</p> + </item> + <item> + <p> + Fixed bug triggered if a process is killed during call to + <c>persistent_term:put</c> or + <c>persistent_term:erase</c>.</p> + <p> + Own Id: OTP-16041</p> + </item> + <item> + <p> + Add units to all memory slogans in the crash dump + documentation.</p> + <p> + Own Id: OTP-16042</p> + </item> + <item> + <p> + Fix a bug in <c>binary_to_term</c> that would crash the + emulator if a term larger than 16GB was to be decoded.</p> + <p> + Own Id: OTP-16058 Aux Id: PR-2382 </p> + </item> + <item> + <p> + Fixed bug related to an exiting process sending EXIT and + DOWN signals to remote linked/monitored processes. Bugs + exists since OTP 22.0.</p> + <p> + Own Id: OTP-16060</p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p><c>erlc</c> can now automatically use a compile server + to avoid starting an Erlang system for each file to be + compiled in a multi-file project. See the documentation + for how to enable it.</p> + <p> + Own Id: OTP-15738 Aux Id: PR-2361 </p> + </item> + <item> + <p> + The possibility to send ancillary data, in particular the + TOS field, has been added to <c>gen_udp:send/4,5</c>.</p> + <p> + Own Id: OTP-15747 Aux Id: ERIERL-294 </p> + </item> + <item> + <p> + The net module has been split into 'net' (kernel) and + prim_net (preloaded).</p> + <p> + Own Id: OTP-15765</p> + </item> + <item> + <p> + Socket counters now works as expected and can also be + extracted with the (new) info function.</p> + <p> + Own Id: OTP-15818</p> + </item> + <item> + <p> + <c>re:run()</c> now avoids validating utf8 in the subject + more than once in the same call. This validation could + previously be performed multiple times when the + <c>global</c> option was passed.</p> + <p> + Own Id: OTP-15831 Aux Id: ERL-876 </p> + </item> + <item> + <p> + The un-documented function <c>erlang:dist_get_stat/1</c> + now returns the real value of what the distribution queue + contains instead of a boolean.</p> + <p> + Own Id: OTP-15905 Aux Id: PR-2270 </p> + </item> + <item> + <p> + ETS <c>ordered_set</c> tables with + <c>write_concurrency</c> enabled has got a performance + issue fixed. There were no limits for the values of + internal statistics counters before this fix. This could + result in that the data structure sometimes reacted + slowly to a change in how many parallel processes were + using it.</p> + <p> + Own Id: OTP-15906</p> + </item> + <item> + <p> + Optimize the reception of large distribution messages.</p> + <p> + Own Id: OTP-15926 Aux Id: PR-2291 </p> + </item> + <item> + <p>Binary matching and functions like + <c>split_binary/2</c> will now create heap binaries when + the results are small enough, reducing the chances of + small sub-binaries keeping large binaries alive.</p> + <p> + Own Id: OTP-15977 Aux Id: ERIERL-366 </p> + </item> + <item> + <p>Fixed rare emulator crash in + <c>instrument:allocations/0-1</c>.</p> + <p> + Own Id: OTP-15983</p> + </item> + <item> + <p> + Ports could pass very small binaries as reference counted + off heap binaries to processes. This could cause an + unnecessary large memory usage and an unnecessary load on + the binary allocator. Small binaries are now always + passed as heap binaries to processes.</p> + <p> + Own Id: OTP-16001 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> + <c>unicode:characters_to_binary()</c> could return very + small binaries as reference counted off heap binaries. + This could cause an unnecessary large memory usage and an + unnecessary load on the binary allocator. Small binaries + are now always returned as heap binaries.</p> + <p> + Own Id: OTP-16002 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> + Improved <c>erl_nif</c> documentation regarding + <c>on_load</c> and Erlang stub/fallback functions.</p> + <p> + Own Id: OTP-16028 Aux Id: PR-2362 </p> + </item> + <item> + <p> + New feature <c>ets:info(_, binary)</c> to get information + about all reference counted binaries kept by a table. + This is the same kind of debug information that + <c>process_info(_, binary)</c> returns for a process.</p> + <p> + Own Id: OTP-16035 Aux Id: ERIERL-366 </p> + </item> + </list> + </section> + +</section> + <section><title>Erts 10.4.4</title> <section><title>Fixed Bugs and Malfunctions</title> @@ -640,6 +965,42 @@ </section> +<section><title>Erts 10.3.5.5</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p><c>process_info(P,binary)</c> would neglect to look + through heap fragments, potentially missing a few + binaries associated with the process.</p> + <p> + Own Id: OTP-15978 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> + Fixed bug triggered if a process is killed during call to + <c>persistent_term:put</c> or + <c>persistent_term:erase</c>.</p> + <p> + Own Id: OTP-16041</p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p>Fixed rare emulator crash in + <c>instrument:allocations/0-1</c>.</p> + <p> + Own Id: OTP-15983</p> + </item> + </list> + </section> + +</section> + <section><title>Erts 10.3.5.4</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/erts/doc/src/socket.xml b/erts/doc/src/socket.xml index 2f7ff2fc07..6b167e7203 100644 --- a/erts/doc/src/socket.xml +++ b/erts/doc/src/socket.xml @@ -327,7 +327,7 @@ </func> <func> - <name name="accept" arity="2" clause_i="1" anchor="accept_async" since="OTP @OTP-15731@"/> + <name name="accept" arity="2" clause_i="1" anchor="accept_async" since="OTP 22.1"/> <fsummary>Accept a connection on a socket.</fsummary> <desc> <p>Accept a connection on a socket.</p> @@ -362,7 +362,7 @@ </func> <func> - <name name="cancel" arity="2" since="OTP @OTP-15731@"/> + <name name="cancel" arity="2" since="OTP 22.1"/> <fsummary>Cancel an asynchronous request.</fsummary> <desc> <p>Cancel an asynchronous request.</p> @@ -403,7 +403,7 @@ </func> <func> - <name name="connect" arity="3" clause_i="1" anchor="connect_async" since="OTP @OTP-15731@"/> + <name name="connect" arity="3" clause_i="1" anchor="connect_async" since="OTP 22.1"/> <fsummary>Initiate a connection on a socket.</fsummary> <desc> <p>This function connects the socket to the address @@ -471,7 +471,7 @@ </func> <func> - <name name="info" arity="1" since="OTP @OTP-15818@"/> + <name name="info" arity="1" since="OTP 22.1"/> <fsummary>Get miscellaneous socket info.</fsummary> <desc> <p>Get miscellaneous info about the socket.</p> @@ -544,8 +544,8 @@ </func> <func> - <name name="recv" arity="3" clause_i="2" anchor="recv_async" since="OTP @OTP-15731@"/> - <name name="recv" arity="4" clause_i="1" since="OTP @OTP-15731@"/> + <name name="recv" arity="3" clause_i="2" anchor="recv_async" since="OTP 22.1"/> + <name name="recv" arity="4" clause_i="1" since="OTP 22.1"/> <fsummary>Receive a message from a socket.</fsummary> <desc> <p>Receive a message from a socket.</p> @@ -596,9 +596,9 @@ </func> <func> - <name name="recvfrom" arity="3" clause_i="1" anchor="recvfrom_async" since="OTP @OTP-15731@"/> - <name name="recvfrom" arity="3" clause_i="4" since="OTP @OTP-15731@"/> - <name name="recvfrom" arity="4" clause_i="1" since="OTP @OTP-15731@"/> + <name name="recvfrom" arity="3" clause_i="1" anchor="recvfrom_async" since="OTP 22.1"/> + <name name="recvfrom" arity="3" clause_i="4" since="OTP 22.1"/> + <name name="recvfrom" arity="4" clause_i="1" since="OTP 22.1"/> <fsummary>Receive a message from a socket.</fsummary> <desc> <p>Receive a message from a socket.</p> @@ -663,9 +663,9 @@ </func> <func> - <name name="recvmsg" arity="2" clause_i="2" anchor="recvmsg_async" since="OTP @OTP-15731@"/> - <name name="recvmsg" arity="3" clause_i="1" since="OTP @OTP-15731@"/> - <name name="recvmsg" arity="5" clause_i="1" since="OTP @OTP-15731@"/> + <name name="recvmsg" arity="2" clause_i="2" anchor="recvmsg_async" since="OTP 22.1"/> + <name name="recvmsg" arity="3" clause_i="1" since="OTP 22.1"/> + <name name="recvmsg" arity="5" clause_i="1" since="OTP 22.1"/> <fsummary>Receive a message from a socket.</fsummary> <desc> <p>Receive a message from a socket.</p> @@ -716,8 +716,8 @@ </func> <func> - <name name="send" arity="3" clause_i="2" anchor="send_async" since="OTP @OTP-15731@"/> - <name name="send" arity="4" clause_i="1" since="OTP @OTP-15731@"/> + <name name="send" arity="3" clause_i="2" anchor="send_async" since="OTP 22.1"/> + <name name="send" arity="4" clause_i="1" since="OTP 22.1"/> <fsummary>Send a message on a socket.</fsummary> <desc> <p>Send a message on a connected socket.</p> @@ -764,8 +764,8 @@ </func> <func> - <name name="sendmsg" arity="3" clause_i="2" anchor="sendmsg_async" since="OTP @OTP-15731@"/> - <name name="sendmsg" arity="4" clause_i="1" since="OTP @OTP-15731@"/> + <name name="sendmsg" arity="3" clause_i="2" anchor="sendmsg_async" since="OTP 22.1"/> + <name name="sendmsg" arity="4" clause_i="1" since="OTP 22.1"/> <fsummary>Send a message on a socket.</fsummary> <desc> <p>Send a message on a socket. The destination, if needed @@ -806,8 +806,8 @@ </func> <func> - <name name="sendto" arity="4" clause_i="2" anchor="sendto_async" since="OTP @OTP-15731@"/> - <name name="sendto" arity="5" clause_i="1" since="OTP @OTP-15731@"/> + <name name="sendto" arity="4" clause_i="2" anchor="sendto_async" since="OTP 22.1"/> + <name name="sendto" arity="5" clause_i="1" since="OTP 22.1"/> <fsummary>Send a message on a socket.</fsummary> <desc> <p>Send a message on a socket, to the specified destination.</p> diff --git a/erts/emulator/beam/erl_db_hash.c b/erts/emulator/beam/erl_db_hash.c index c6b6e66e3e..5937bd64ec 100644 --- a/erts/emulator/beam/erl_db_hash.c +++ b/erts/emulator/beam/erl_db_hash.c @@ -3216,6 +3216,12 @@ void db_foreach_offheap_hash(DbTable *tbl, int i; int nactive = NACTIVE(tb); + if (nactive > tb->nslots) { + /* Table is being emptied by delete/1 or delete_all_objects/1 */ + ASSERT(!(tb->common.status & (DB_PRIVATE|DB_PROTECTED|DB_PUBLIC))); + nactive = tb->nslots; + } + for (i = 0; i < nactive; i++) { list = BUCKET(tb,i); while(list != 0) { diff --git a/erts/emulator/beam/erl_process.c b/erts/emulator/beam/erl_process.c index a564a1d7c5..ac0a4f8902 100644 --- a/erts/emulator/beam/erl_process.c +++ b/erts/emulator/beam/erl_process.c @@ -12073,6 +12073,7 @@ erts_proc_exit_handle_dist_monitor(ErtsMonitor *mon, void *vctxt, Sint reds) ASSERT(c_p->flags & F_DISABLE_GC); ASSERT(erts_monitor_is_target(mon) && mon->type == ERTS_MON_TYPE_DIST_PROC); ASSERT(ctxt->dist_state == NIL); + ASSERT(!ctxt->yield); mdp = erts_monitor_to_data(mon); @@ -12119,10 +12120,12 @@ erts_proc_exit_handle_dist_monitor(ErtsMonitor *mon, void *vctxt, Sint reds) switch (code) { case ERTS_DSIG_SEND_YIELD: reds_consumed = reds; /* force yield */ + ctxt->yield = 1; break; case ERTS_DSIG_SEND_CONTINUE: ctxt->dist_state = erts_dsend_export_trap_context(c_p, &ctx); reds_consumed = reds; /* force yield */ + ctxt->yield = 1; break; case ERTS_DSIG_SEND_OK: break; @@ -12334,6 +12337,7 @@ erts_proc_exit_handle_dist_link(ErtsLink *lnk, void *vctxt, Sint reds) ASSERT(c_p->flags & F_DISABLE_GC); ASSERT(lnk->type == ERTS_LNK_TYPE_DIST_PROC); ASSERT(ctxt->dist_state == NIL); + ASSERT(!ctxt->yield); dlnk = erts_link_to_other(lnk, &ldp); dist = ((ErtsLinkDataExtended *) ldp)->dist; @@ -12373,10 +12377,12 @@ erts_proc_exit_handle_dist_link(ErtsLink *lnk, void *vctxt, Sint reds) switch (code) { case ERTS_DSIG_SEND_YIELD: reds_consumed = reds; /* force yield */ + ctxt->yield = 1; break; case ERTS_DSIG_SEND_CONTINUE: ctxt->dist_state = erts_dsend_export_trap_context(c_p, &ctx); reds_consumed = reds; /* force yield */ + ctxt->yield = 1; break; case ERTS_DSIG_SEND_OK: break; @@ -12799,6 +12805,7 @@ restart: trap_state->pectxt.dist_links = NULL; trap_state->pectxt.dist_monitors = NULL; trap_state->pectxt.dist_state = NIL; + trap_state->pectxt.yield = 0; erts_proc_lock(p, ERTS_PROC_LOCK_MSGQ); @@ -12901,7 +12908,7 @@ restart: (void *) &trap_state->pectxt, &trap_state->yield_state, reds); - if (reds <= 0 || is_not_nil(trap_state->pectxt.dist_state)) + if (reds <= 0 || trap_state->pectxt.yield) goto yield; trap_state->phase = ERTS_CONTINUE_EXIT_DIST_MONITORS; } @@ -12916,7 +12923,7 @@ restart: (void *) &trap_state->pectxt, &trap_state->yield_state, reds); - if (reds <= 0 || is_not_nil(trap_state->pectxt.dist_state)) + if (reds <= 0 || trap_state->pectxt.yield) goto yield; trap_state->phase = ERTS_CONTINUE_EXIT_DONE; @@ -13001,6 +13008,7 @@ restart: sys_memcpy(trap_state, &static_state, sizeof(*trap_state)); p->u.terminate = trap_state; } + trap_state->pectxt.yield = 0; ASSERT(p->scheduler_data); ASSERT(p->scheduler_data->current_process == p); diff --git a/erts/emulator/beam/erl_process.h b/erts/emulator/beam/erl_process.h index 13cc2ce1fa..5886b576e0 100644 --- a/erts/emulator/beam/erl_process.h +++ b/erts/emulator/beam/erl_process.h @@ -1831,6 +1831,7 @@ typedef struct { ErtsLink *dist_links; ErtsMonitor *dist_monitors; Eterm dist_state; + int yield; } ErtsProcExitContext; int erts_proc_exit_handle_monitor(ErtsMonitor *mon, void *vctxt, Sint reds); int erts_proc_exit_handle_link(ErtsLink *lnk, void *vctxt, Sint reds); diff --git a/erts/emulator/beam/external.c b/erts/emulator/beam/external.c index ce61cdf040..39bbf62eae 100644 --- a/erts/emulator/beam/external.c +++ b/erts/emulator/beam/external.c @@ -1414,7 +1414,7 @@ enum B2TState { /* order is somewhat significant */ }; typedef struct { - int heap_size; + Sint heap_size; int terms; byte* ep; int atom_extra_skip; @@ -4633,7 +4633,7 @@ encode_size_struct_int(TTBSizeContext* ctx, ErtsAtomCacheMap *acmp, Eterm obj, static Sint decoded_size(byte *ep, byte* endp, int internal_tags, B2TContext* ctx) { - int heap_size; + Sint heap_size; int terms; int atom_extra_skip; Uint n; diff --git a/erts/emulator/test/lcnt_SUITE.erl b/erts/emulator/test/lcnt_SUITE.erl index 2dbaec9942..7bee7cf1d4 100644 --- a/erts/emulator/test/lcnt_SUITE.erl +++ b/erts/emulator/test/lcnt_SUITE.erl @@ -24,8 +24,7 @@ -export( [all/0, suite/0, - init_per_suite/1, end_per_suite/1, - init_per_testcase/2, end_per_testcase/2]). + init_per_suite/1, end_per_suite/1]). -export( [toggle_lock_counting/1, error_on_invalid_category/1, preserve_locks/1, @@ -63,13 +62,6 @@ end_per_suite(Config) -> erts_debug:lcnt_clear(), ok. -init_per_testcase(_Case, Config) -> - disable_lock_counting(), - Config. - -end_per_testcase(_Case, _Config) -> - ok. - disable_lock_counting() -> ok = erts_debug:lcnt_control(copy_save, false), ok = erts_debug:lcnt_control(mask, []), @@ -96,7 +88,10 @@ wait_for_empty_lock_list(Tries) when Tries > 0 -> wait_for_empty_lock_list(Tries - 1) end; wait_for_empty_lock_list(0) -> - ct:fail("Lock list failed to clear after disabling lock counting."). + [{duration, _}, {locks, Locks0}] = erts_debug:lcnt_collect(), + Locks = remove_untoggleable_locks(Locks0), + ct:fail("Lock list failed to clear after disabling lock counting.~n\t~p", + [Locks]). %% Queue up a lot of thread progress cleanup ops in a vain attempt to %% flush the lock list. @@ -109,6 +104,8 @@ try_flush_cleanup_ops() -> %% toggle_lock_counting(Config) when is_list(Config) -> + ok = disable_lock_counting(), + Categories = [allocator, db, debug, distribution, generic, io, process, scheduler], lists:foreach( @@ -131,6 +128,8 @@ get_lock_info_for(Category) when is_atom(Category) -> get_lock_info_for([Category]). preserve_locks(Config) when is_list(Config) -> + ok = disable_lock_counting(), + erts_debug:lcnt_control(mask, [process]), erts_debug:lcnt_control(copy_save, true), @@ -155,10 +154,14 @@ preserve_locks(Config) when is_list(Config) -> end. error_on_invalid_category(Config) when is_list(Config) -> + ok = disable_lock_counting(), + {error, badarg, q_invalid} = erts_debug:lcnt_control(mask, [q_invalid]), ok. registered_processes(Config) when is_list(Config) -> + ok = disable_lock_counting(), + %% There ought to be at least one registered process (init/code_server) erts_debug:lcnt_control(mask, [process]), [_, {locks, ProcLocks}] = erts_debug:lcnt_collect(), @@ -170,6 +173,8 @@ registered_processes(Config) when is_list(Config) -> ok. registered_db_tables(Config) when is_list(Config) -> + ok = disable_lock_counting(), + %% There ought to be at least one registered table (code) erts_debug:lcnt_control(mask, [db]), [_, {locks, DbLocks}] = erts_debug:lcnt_collect(), @@ -187,7 +192,7 @@ remove_untoggleable_locks([]) -> []; remove_untoggleable_locks([{resource_monitors, _, _, _} | T]) -> remove_untoggleable_locks(T); -remove_untoggleable_locks([{'socket[gcnt]', _, _, _} | T]) -> +remove_untoggleable_locks([{'esock[gcnt]', _, _, _} | T]) -> %% Global lock used by socket NIF remove_untoggleable_locks(T); remove_untoggleable_locks([H | T]) -> diff --git a/erts/vsn.mk b/erts/vsn.mk index f06fd08540..d1db2ceceb 100644 --- a/erts/vsn.mk +++ b/erts/vsn.mk @@ -18,7 +18,7 @@ # %CopyrightEnd% # -VSN = 10.4.4 +VSN = 10.5 # Port number 4365 in 4.2 # Port number 4366 in 4.3 diff --git a/lib/common_test/doc/src/ct_netconfc.xml b/lib/common_test/doc/src/ct_netconfc.xml index 8fbe5f3df6..f4d98b611b 100644 --- a/lib/common_test/doc/src/ct_netconfc.xml +++ b/lib/common_test/doc/src/ct_netconfc.xml @@ -4,7 +4,7 @@ <erlref> <header> <copyright> - <year>2010</year><year>2017</year> + <year>2010</year><year>2019</year> <holder>Ericsson AB. All Rights Reserved.</holder> </copyright> <legalnotice> @@ -37,51 +37,64 @@ <description> - <p>NETCONF client module.</p> - - <p>The NETCONF client is compliant with RFC 4741 NETCONF Configuration - Protocol and RFC 4742 Using the NETCONF Configuration Protocol over - Secure SHell (SSH).</p> + <p>NETCONF client module compliant with RFC 6241, NETCONF Configuration + Protocol, and RFC 6242, Using the NETCONF Configuration Protocol over + Secure SHell (SSH), and with support for RFC 5277, NETCONF Event + Notifications.</p> <marker id="Connecting"/> <p><em>Connecting to a NETCONF server</em></p> - <p>NETCONF sessions can either be opened by a single call - to <seealso marker="#open-1"><c>open/1,2</c></seealso> or by a call - to <seealso marker="#connect-1"><c>connect/1,2</c></seealso> followed - by one or more calls to - <seealso marker="#session-1"><c>session/1,2,3</c></seealso>.</p> - - <p>The properties of the sessions will be exactly the same, except - that when - using <seealso marker="#connect-1"><c>connect/1,2</c></seealso>, you - may start multiple sessions over the same SSH connection. Each - session is implemented as an SSH channel.</p> - - <p><seealso marker="#open-1"><c>open/1,2</c></seealso> will establish one - SSH connection with one SSH channel implementing one NETCONF - session. You may start mutiple sessions by - calling <seealso marker="#open-1"><c>open/1,2</c></seealso> multiple - times, but then a new SSH connection will be established for each - session.</p> - - <p>For each server to test against, the following entry can be added to a - configuration file:</p> + <p>Call <seealso marker="#connect-1"><c>connect/1,2</c></seealso> + to establish a connection to a server, then pass the returned + handle to <seealso marker="#session-1"><c>session/1-3</c></seealso> to + establish a NETCONF session on a new SSH channel. + Each call to + <seealso marker="#session-1"><c>session/1-3</c></seealso> establishes a + new session on the same connection, and results in a hello message + to the server.</p> + + <p>Alternately, + <seealso marker="#open-1"><c>open/1,2</c></seealso> can be used to + establish a single session on a dedicated connection. + (Or, equivalently, + <seealso marker="#only_open-1"><c>only_open/1,2</c></seealso> + followed by <seealso marker="#hello-1"><c>hello/1-3</c></seealso>.)</p> + + <p>Connect/session options can be specified in a configuration + file with entries like the following.</p> <pre> - {server_id(),options()}.</pre> + {server_id(), [option()]}.</pre> <p>The <seealso marker="#type-server_id"><c>server_id()</c></seealso> - or an associated - <seealso marker="ct#type-target_name"><c>ct:target_name()</c></seealso> - must then be used in calls to - <seealso marker="#connect-2"><c>connect/2</c></seealso> - or <seealso marker="#open-2"><c>open/2</c></seealso>.</p> - - <p>If no configuration exists for a server, - use <seealso marker="#connect-1"><c>connect/1</c></seealso> - or <seealso marker="#open-1"><c>open/1</c></seealso> instead, - and specify all necessary options in the <c>Options</c> parameter.</p> + or an associated + <seealso marker="ct#type-target_name"><c>ct:target_name()</c></seealso> + can then be passed to the aforementioned functions to use the + referenced configuration.</p> + + <marker id="Signaling"/> + <p><em>Signaling</em></p> + + <p>Protocol operations in the NETCONF protocol are realized as remote + procedure calls (RPCs) from client to server and a corresponding + reply from server to client. + RPCs are sent using like-named functions (eg. + <seealso marker="#edit_config-3"><c>edit_config/3-5</c></seealso> + to send an edit-config RPC), with the server reply + as return value. + There are functions for each RPC defined in RFC 6241 and + the create-subscription RPC from RFC 5277, all of which are + wrappers on <seealso marker="#send_rpc-2"><c>send_rpc/2,3</c></seealso>, + that can be used to send an arbitrary RPC + not defined in RFC 6241 or RFC 5277.</p> + + <p>All of the signaling functions have one variant with a + <c>Timeout</c> argument and one without, corresponding to an + infinite timeout. + The latter is inappropriate in most cases since a non-response by + the server or a missing message-id causes the call to hang + indefinitely.</p> <marker id="Logging"/> <p><em>Logging</em></p> @@ -93,7 +106,7 @@ <pre> suite() -> - [{ct_hooks, [{cth_conn_log, [{<seealso marker="ct#type-conn_log_mod"><c>ct:conn_log_mod()</c></seealso>,<seealso marker="ct#type-conn_log_options"><c>ct:conn_log_options()</c></seealso>}]}]}].</pre> + [{ct_hooks, [{cth_conn_log, [{<seealso marker="ct#type-conn_log_mod"><c>ct:conn_log_mod()</c></seealso>, <seealso marker="ct#type-conn_log_options"><c>ct:conn_log_options()</c></seealso>}]}]}].</pre> <p><c>conn_log_mod()</c> is the name of the <c>Common Test</c> module implementing the connection protocol, for example, <c>ct_netconfc</c>.</p> @@ -133,7 +146,7 @@ configuration variable <c>ct_conn_log</c>:</p> <pre> - {ct_conn_log,[{<seealso marker="ct#type-conn_log_mod"><c>ct:conn_log_mod()</c></seealso>,<seealso marker="ct#type-conn_log_options"><c>ct:conn_log_options()</c></seealso>}]}.</pre> + {ct_conn_log,[{<seealso marker="ct#type-conn_log_mod"><c>ct:conn_log_mod()</c></seealso>, <seealso marker="ct#type-conn_log_options"><c>ct:conn_log_options()</c></seealso>}]}.</pre> <p>For example:</p> @@ -185,100 +198,111 @@ would cause HTML logging of all NETCONF connections in to the test case HTML log.</p> - <marker id="Notifications"/> - <p><em>Notifications</em></p> - - <p>The NETCONF client is also compliant with RFC 5277 NETCONF Event - Notifications, which defines a mechanism for an asynchronous message - notification delivery service for the NETCONF protocol.</p> - - <p>Specific functions to support this are - <seealso marker="#create_subscription-1"><c>create_subscription/1-6</c></seealso> - and - <seealso marker="#get_event_streams-1"><c>get_event_streams/1-3</c></seealso>.</p> - - <marker id="Default_timeout"/> - <p><em>Default Timeout</em></p> - - <p>Most of the functions in this module have one variant with - a <c>Timeout</c> parameter, and one without. If nothing else is - specified, the default value <c>infinity</c> is used when - the <c>Timeout</c> parameter is not given.</p> - </description> + <!-- ====================================================================== --> + <datatypes> <datatype> <name name="client"/> - </datatype> - <datatype> - <name name="error_reason"/> - </datatype> - <datatype> - <name name="event_time"/> + <desc> + <p>Handle to a NETCONF session, as required by signaling + functions.</p> + </desc> </datatype> <datatype> <name name="handle"/> <desc> - <p>Opaque reference for a connection to a NETCONF server or a - NETCONF session.</p> + <p>Handle to a connection to a NETCONF server as + returned by + <seealso marker="#connect-1"><c>connect/1,2</c></seealso>, + or to a session as returned by + <seealso marker="#session-1"><c>session/1-3</c></seealso>, + <seealso marker="#open-1"><c>open/1,2</c></seealso>, + or <seealso marker="#only_open-1"><c>only_open/1,2</c></seealso>.</p> </desc> </datatype> <datatype> - <name name="host"/> - </datatype> - <datatype> - <name name="netconf_db"/> + <name name="xs_datetime"/> + <desc> + <p>Date and time of a startTime/stopTime element in an RFC + 5277 create-subscription request. Of XML primitive type + <c>dateTime</c>, which has the (informal) form</p> + <pre> + [-]YYYY-MM-DDThh:mm:ss[.s][Z|(+|-)hh:mm]</pre> + <p>where <c>T</c> and <c>Z</c> are literal and <c>.s</c> is + one or more fractional seconds.</p> + </desc> </datatype> <datatype> - <name name="notification"/> + <name name="event_time"/> </datatype> <datatype> <name name="notification_content"/> </datatype> <datatype> - <name name="option"/> + <name name="notification"/> <desc> - <p><c>SshConnectOption</c> is any valid option to - <seealso marker="ssh:ssh#connect-3"><c>ssh:connect/3,4</c></seealso>. - Common options used are <c>user</c>, <c>password</c> - and <c>user_dir</c>. The <c>SshConnectOptions</c> are - verfied by the SSH application.</p> + <p>Event notification messages sent as a result of calls to + <seealso marker="#create_subscription-2"><c>create_subscription/2,3</c></seealso>.</p> </desc> </datatype> <datatype> - <name name="options"/> + <name name="option"/> <desc> - <p>Options used for setting up an SSH connection to a NETCONF - server.</p> + <p>Options <c>host</c> and <c>port</c> specify the + server endpoint to which to connect, and are passed directly + to <seealso + marker="ssh:ssh#connect-3"><c>ssh:connect/4</c></seealso>, + as are arbitrary ssh options. Common options are <c>user</c>, + <c>password</c> and <c>user_dir</c>.</p> + + <p>Option <c>timeout</c> specifies the number of + milliseconds to allow for connection establishment and, if the + function in question results in an outgoing hello message, + reception of the server hello. The timeout applies to + connection and hello independently; + one timeout for connection establishment, another for hello + reception.</p> + + <p>Option <c>capability</c> specifies the content of a + corresponding element in an outgoing hello message, each + option specifying the content of a single element. + If no base NETCONF capability is configured then the RFC 4741 + 1.0 capability, "urn:ietf:params:netconf:base:1.0", is added, + otherwise not. + In particular, the RFC 6241 1.1 capability must be explicitly + configured. + NETCONF capabilities can be specified using the shorthand notation + defined in RFC 6241, any capability string starting with a + colon being prefixed by either "urn:ietf:params:netconf" or + "urn:ietf:params:netconf:capability", as appropriate.</p> + + <p>Capability options are ignored by connect/1-3 and only_open/1-2, + which don't result in an outgoing hello message.</p> </desc> </datatype> <datatype> <name name="server_id"/> <desc> - <p>The identity of a server, specified in a configuration - file.</p> - </desc> - </datatype> - <datatype> - <name name="simple_xml"/> - <desc> - <p>This type is further described in application - <seealso marker="xmerl:index"><c>xmerl</c></seealso>.</p> + <p>Identity of connection or session configuration in a + configuration file.</p> </desc> </datatype> <datatype> <name name="stream_data"/> - <desc> - <p>For details about the data format for the string values, see - "XML Schema for Event Notifications" in RFC 5277.</p> - </desc> </datatype> <datatype> <name name="stream_name"/> </datatype> <datatype> <name name="streams"/> + <desc> + <p>Stream information as returned by + <seealso marker="#get_event_streams-1"><c>get_event_streams/1-3</c></seealso>. + See RFC 5277, "XML Schema for Event Notifications", for detail + on the format of the string values.</p> + </desc> </datatype> <datatype> <name name="xml_attribute_tag"/> @@ -296,20 +320,28 @@ <name name="xml_tag"/> </datatype> <datatype> + <name name="simple_xml"/> + <desc> + <p>Representation of XML, as described in application + <seealso marker="xmerl:index"><c>xmerl</c></seealso>.</p> + </desc> + </datatype> + <datatype> <name name="xpath"/> </datatype> <datatype> - <name name="xs_datetime"/> - <desc> - <p>This date and time identifier has the same format as the XML type - <c>dateTime</c> and is compliant with RFC 3339 Date and Time on - the Internet Timestamps. The format is as follows:</p> - <pre> - [-]CCYY-MM-DDThh:mm:ss[.s][Z|(+|-)hh:mm]</pre> - </desc> + <name name="error_reason"/> + </datatype> + <datatype> + <name name="host"/> + </datatype> + <datatype> + <name name="netconf_db"/> </datatype> </datatypes> + <!-- ====================================================================== --> + <funcs> <func> <name name="action" arity="2" since="OTP R15B02"/> @@ -352,11 +384,7 @@ reference returned from this function is required as connection identifier when opening sessions over this connection, see - <seealso marker="#session-1"><c>session/1,2,3</c></seealso>.</p> - - <p>Option <c>timeout</c> (milliseconds) is used when setting up the - SSH connection. It is not used for any other purposes during the - lifetime of the connection.</p> + <seealso marker="#session-1"><c>session/1-3</c></seealso>.</p> </desc> </func> @@ -371,10 +399,9 @@ <c>target_name()</c> associated with such an Id, then the options for this server are fetched from the configuration file.</p> - <p>Argument <c><anno>ExtraOptions</anno></c> is added to the - options found in the configuration file. If the same options - are specified, the values from the configuration file - overwrite <c><anno>ExtraOptions</anno></c>.</p> + <p>The options list is added to those of the + configuration file. If an option is specified in both lists, + the configuration file takes precedence.</p> <p>If the server is not specified in a configuration file, use <seealso marker="#connect-1"><c>connect/1</c></seealso> @@ -384,17 +411,13 @@ reference returned from this function can be used as connection identifier when opening sessions over this connection, see - <seealso marker="#session-1"><c>session/1,2,3</c></seealso>. + <seealso marker="#session-1"><c>session/1-3</c></seealso>. However, if <c><anno>KeyOrName</anno></c> is a <c>target_name()</c>, that is, if the server is named through a call to <seealso marker="ct#require-2"><c>ct:require/2</c></seealso> or a <c>require</c> statement in the test suite, then this name can be used instead of <seealso marker="#type-handle"><c>handle()</c></seealso>.</p> - - <p>Option <c>timeout</c> (milliseconds) is used when setting up the - SSH connection. It is not used for any other purposes during the - lifetime of the connection.</p> </desc> </func> @@ -412,80 +435,61 @@ </func> <func> - <name since="OTP R15B02">create_subscription(Client) -> Result</name> - <name since="OTP R15B02">create_subscription(Client, Stream) -> Result</name> - <name since="OTP R15B02">create_subscription(Client, Stream, Filter) -> Result</name> - <name since="OTP R15B02">create_subscription(Client, Stream, Filter, Timeout) -> Result</name> - <name name="create_subscription" arity="5" clause_i="2" since="OTP R15B02"/> - <name name="create_subscription" arity="6" since="OTP R15B02"/> + <name name="create_subscription" arity="2" clause_i="1" since="OTP 22.1"/> + <name name="create_subscription" arity="3" clause_i="1" since="OTP 22.1"/> <fsummary>Creates a subscription for event notifications.</fsummary> <desc> - <p>Creates a subscription for event notifications.</p> - - <p>This function sets up a subscription for NETCONF event - notifications of the specified stream type, matching the specified - filter. The calling process receives notifications as messages of - type <seealso marker="#type-notification"><c>notification()</c></seealso>.</p> - - <p>Only a subset of the function clauses are show above. The - full set of valid combinations of input parameters is as - follows:</p> - -<pre>create_subscription(Client) + <p>Creates a subscription for event notifications by sending + an RFC 5277 create-subscription RPC to the server. + The calling process receives events as messages of + type <seealso marker="#type-notification"><c>notification()</c></seealso>.</p> -create_subscription(Client, Timeout) -create_subscription(Client, Stream) -create_subscription(Client, Filter) - -create_subscription(Client, Stream, Timeout) -create_subscription(Client, Filter, Timeout) -create_subscription(Client, Stream, Filter) -create_subscription(Client, StartTime, StopTime) - -create_subscription(Client, Stream, Filter, Timeout) -create_subscription(Client, StartTime, StopTime, Timeout) -create_subscription(Client, Stream, StartTime, StopTime) -create_subscription(Client, Filter, StartTime, StopTime) - -create_subscription(Client, Stream, StartTime, StopTime, Timeout) -create_subscription(Client, Stream, Filter, StartTime, StopTime) -create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> + <p>From RFC 5722, 2.1 Subscribing to Receive Event Notifications:</p> <taglist> <tag><c><anno>Stream</anno></c></tag> - <item><p>Optional parameter that indicates which stream of event + <item><p>Indicates which stream of event is of interest. If not present, events in the default NETCONF stream are sent.</p></item> <tag><c><anno>Filter</anno></c></tag> - <item><p>Optional parameter that indicates which subset of all + <item><p>Indicates which subset of all possible events is of interest. The parameter format is the same as that of the filter parameter in the NETCONF protocol operations. If not present, all events not precluded by other parameters are sent.</p></item> <tag><c><anno>StartTime</anno></c></tag> - <item><p>Optional parameter used to trigger the replay feature and + <item><p>Used to trigger the replay feature and indicate that the replay is to start at the time specified. If <c><anno>StartTime</anno></c> is not present, this is not a - replay subscription.</p> - <p>It is not valid to specify start times that are later than + replay subscription. + It is not valid to specify start times that are later than the current time. If <c><anno>StartTime</anno></c> is specified earlier than the log can support, the replay begins with the - earliest available notification.</p> - <p>This parameter is of type <c>dateTime</c> and compliant to + earliest available notification. + This parameter is of type <c>dateTime</c> and compliant to RFC 3339. Implementations must support time zones.</p></item> <tag><c><anno>StopTime</anno></c></tag> - <item><p>Optional parameter used with the optional replay feature + <item><p>Used with the optional replay feature to indicate the newest notifications of interest. If <c><anno>StopTime</anno></c> is not present, the notifications - continues until the subscription is terminated.</p> - <p>Must be used with and be later than <c>StartTime</c>. Values + continues until the subscription is terminated. + Must be used with and be later than <c>StartTime</c>. Values of <c><anno>StopTime</anno></c> in the future are valid. This parameter is of type <c>dateTime</c> and compliant to RFC 3339. Implementations must support time zones.</p></item> </taglist> - <p>For more details about the event notification mechanism, see - RFC 5277.</p> + <p>See RFC 5277 for more details. The requirement that + <c>StopTime</c> must only be used with <c>StartTime</c> is not + enforced, to allow an invalid request to be sent to the + server.</p> + + <p>Prior to OTP 22.1, this function was documented as having + 15 variants in 6 arities. These are still exported for + backwards compatibility, but no longer documented. + The map-based variants documented above provide the same + functionality with simpler arguments.</p> + </desc> </func> @@ -561,23 +565,7 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> <name name="get_capabilities" arity="2" since="OTP R15B02"/> <fsummary>Returns the server side capabilities.</fsummary> <desc> - <p>Returns the server side capabilities.</p> - - <p>The following capability identifiers, defined in RFC 4741 NETCONF - Configuration Protocol, can be returned:</p> - - <list> - <item><p><c>"urn:ietf:params:netconf:base:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:writable-running:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:candidate:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:confirmed-commit:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:rollback-on-error:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:startup:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:url:1.0"</c></p></item> - <item><p><c>"urn:ietf:params:netconf:capability:xpath:1.0"</c></p></item> - </list> - - <p>More identifiers can exist, for example, server-side namespace.</p> + <p>Returns the server capabilities as received in its hello message.</p> </desc> </func> @@ -652,10 +640,12 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> <name name="hello" arity="3" since="OTP 17.5.3"/> <fsummary>Exchanges hello messages with the server.</fsummary> <desc> - <p>Exchanges <c>hello</c> messages with the server.</p> + <p>Exchanges <c>hello</c> messages with the server. Returns + when the server hello has been received or after the + specified timeout.</p> - <p>Adds optional capabilities and sends a <c>hello</c> message to the - server and waits for the return.</p> + <p>Note that capabilities for an outgoing hello can be passed + directly to <seealso marker="#open-2"><c>open/2</c></seealso>.</p> </desc> </func> @@ -740,11 +730,6 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> reference returned from this function is required as client identifier when calling any other function in this module.</p> - - <p>Option <c>timeout</c> (milliseconds) is used when setting up the - SSH connection and when waiting for the <c>hello</c> message from - the server. It is not used for any other purposes during the - lifetime of the connection.</p> </desc> </func> @@ -761,10 +746,9 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> <c>target_name()</c> associated with such an Id, then the options for this server are fetched from the configuration file.</p> - <p>Argument <c><anno>ExtraOptions</anno></c> is added to the - options found in the configuration file. If the same - options are specified, the values from the configuration - file overwrite <c><anno>ExtraOptions</anno></c>.</p> + <p>The options list is added to those of the + configuration file. If an option is specified in both lists, + the configuration file take precedence.</p> <p>If the server is not specified in a configuration file, use <seealso marker="#open-1"><c>open/1</c></seealso> @@ -780,11 +764,6 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> be used instead of <seealso marker="#type-handle"><c>handle()</c></seealso>.</p> - <p>Option <c>timeout</c> (milliseconds) is used when setting up the - SSH connection and when waiting for the <c>hello</c> message from - the server. It is not used for any other purposes during the - lifetime of the connection.</p> - <p>See also <seealso marker="ct#require-2"><c>ct:require/2</c></seealso>.</p> </desc> @@ -827,7 +806,6 @@ create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout)</pre> <fsummary>Opens a NETCONF session as a channel on the given SSH connection, and exchanges hello messages with the server.</fsummary> - <type name="session_options"/> <type name="session_option"/> <desc> <p>Opens a NETCONF session as a channel on the given SSH diff --git a/lib/common_test/doc/src/notes.xml b/lib/common_test/doc/src/notes.xml index c454608bbe..39388fd5ed 100644 --- a/lib/common_test/doc/src/notes.xml +++ b/lib/common_test/doc/src/notes.xml @@ -33,6 +33,64 @@ <file>notes.xml</file> </header> +<section><title>Common_Test 1.18</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + If a ct hook is installed in the <c>suite/0</c> function + in a test suite, then the hook's <c>terminate/1</c> + function would be called several times without it's + <c>init/2</c> function being called first. This is now + corrected.</p> + <p> + Own Id: OTP-15863 Aux Id: ERIERL-370 </p> + </item> + <item> + <p> + If <c>init_per_testcase</c> fails, the test itself is + skipped. According to the documentation, it should be + possible to change the result to failed in a hook + function. The only available hook function in this case + is <c>post_init_per_testcase</c>, but changing the return + value there did not affect the test case result. This is + now corrected.</p> + <p> + Own Id: OTP-15869 Aux Id: ERIERL-350 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Add ct_netconfc support for NETCONF 1.1 (RFC 6241). The + 1.1 base capability can be sent in hello, and RFC 6242 + chunk framing is applied when both client and server + advertise 1.1 support.</p> + <p> + Own Id: OTP-15789</p> + </item> + <item> + <p> + Correct lib_dir paths in common_tests opaque data + structure that is passed to ct_release_test callback + modules in functions upgrade_init/2, upgrade_upgraded/2 + and upgrade_downgraded/2. The incorrect paths may cause + confusion when debugging although it will not cause any + incorrect behavior on the part of common_test as it is + currently not used.</p> + <p> + Own Id: OTP-15934</p> + </item> + </list> + </section> + +</section> + <section><title>Common_Test 1.17.3</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/common_test/src/ct_netconfc.erl b/lib/common_test/src/ct_netconfc.erl index 6a758c4ea3..7ad6fa46e8 100644 --- a/lib/common_test/src/ct_netconfc.erl +++ b/lib/common_test/src/ct_netconfc.erl @@ -1,7 +1,7 @@ %%---------------------------------------------------------------------- %% %CopyrightBegin% %% -%% Copyright Ericsson AB 2012-2017. All Rights Reserved. +%% Copyright Ericsson AB 2012-2019. All Rights Reserved. %% %% Licensed under the Apache License, Version 2.0 (the "License"); %% you may not use this file except in compliance with the License. @@ -26,7 +26,7 @@ %% Netconf servers can be configured by adding the following statement %% to a configuration file: %% -%% {server_id(),options()}. +%% {server_id(), [option()]}. %% %% The server_id() or an associated ct:target_name() shall then be %% used in calls to open/2 connect/2. @@ -55,13 +55,14 @@ %% The netconf client is also compliant with RFC5277 NETCONF Event %% Notifications, which defines a mechanism for an asynchronous %% message notification delivery service for the netconf protocol. -%% -%% Specific functions to support this are create_subscription/6 -%% get_event_streams/3. (The functions also exist with other arities.) +%% Functions supporting this are create_subscription/3 +%% get_event_streams/3. %% %%---------------------------------------------------------------------- -module(ct_netconfc). +-dialyzer(no_improper_lists). + -include("ct_netconfc.hrl"). -include("ct_util.hrl"). -include_lib("xmerl/include/xmerl.hrl"). @@ -107,12 +108,8 @@ copy_config/4, action/2, action/3, - create_subscription/1, create_subscription/2, create_subscription/3, - create_subscription/4, - create_subscription/5, - create_subscription/6, get_event_streams/1, get_event_streams/2, get_event_streams/3, @@ -121,6 +118,12 @@ get_session_id/1, get_session_id/2]). +%% historic, no longer documented +-export([create_subscription/1, + create_subscription/4, + create_subscription/5, + create_subscription/6]). + %%---------------------------------------------------------------------- %% Exported types %%---------------------------------------------------------------------- @@ -163,6 +166,9 @@ (is_atom(Xml) orelse (is_tuple(Xml) andalso is_atom(element(1,Xml))))). -define(is_string(S), (is_list(S) andalso is_integer(hd(S)))). +%% Keys into the process dictionary. +-define(KEY(T), {?MODULE, T}). + %%---------------------------------------------------------------------- %% Records %%---------------------------------------------------------------------- @@ -173,9 +179,9 @@ capabilities, session_id, msg_id = 1, - hello_status, - no_end_tag_buff = <<>>, - buff = <<>>, + hello_status, % undefined | received | #pending{} + % string() | {error, Reason} + buf = false, % binary() | list() | boolean() pending = [], % [#pending] event_receiver}).% pid @@ -195,10 +201,9 @@ type}). %% Pending replies from server --record(pending, {tref, % timer ref (returned from timer:xxx) - ref, % pending ref +-record(pending, {tref :: false | reference(), % timer reference msg_id, - op, + op, caller}).% pid which sent the request %%---------------------------------------------------------------------- @@ -207,13 +212,14 @@ -type client() :: handle() | server_id() | ct:target_name(). -opaque handle() :: pid(). --type options() :: [option()]. --type option() :: {ssh,host()} | {port,inet:port_number()} | {user,string()} | - {password,string()} | {user_dir,string()} | - {timeout,timeout()}. +-type option() :: {host | ssh, host()} + | {port, inet:port_number()} + | {timeout, timeout()} + | {capability, string() | [string()]} + | ssh:client_option(). --type session_options() :: [session_option()]. --type session_option() :: {timeout,timeout()}. +-type session_option() :: {timeout,timeout()} + | {capability, string() | [string()]}. -type host() :: inet:hostname() | inet:ip_address(). @@ -258,33 +264,44 @@ %% Open an SSH connection to a Netconf server %% If the server options are specified in a configuration file, use %% open/2. + +%% connect/1 + -spec connect(Options) -> Result when - Options :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + Options :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. connect(Options) -> - do_connect(Options, #options{type=connection},[]). + connect(Options, #options{type = connection}, []). + +%% connect/2 --spec connect(KeyOrName,ExtraOptions) -> Result when +-spec connect(KeyOrName, ExtraOptions) -> Result when KeyOrName :: ct:key_or_name(), - ExtraOptions :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + ExtraOptions :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. + connect(KeyOrName, ExtraOptions) -> - SortedExtra = lists:keysort(1,ExtraOptions), - SortedConfig = lists:keysort(1,ct:get_config(KeyOrName,[])), - AllOpts = lists:ukeymerge(1,SortedConfig,SortedExtra), - do_connect(AllOpts,#options{name=KeyOrName,type=connection},[{name,KeyOrName}]). - -do_connect(OptList,InitOptRec,NameOpt) -> - case check_options(OptList,InitOptRec) of - {Host,Port,Options} -> - ct_gen_conn:start({Host,Port},Options,?MODULE, - NameOpt ++ [{reconnect,false}, - {use_existing_connection,false}, - {forward_messages,false}]); - Error -> - Error + connect(make_opts(KeyOrName, ExtraOptions), + #options{name = KeyOrName, type = connection}, + [{name, KeyOrName}]). + +%% connect/3 + +connect(Opts, InitRec, NameOpt) -> + case make_options(Opts, InitRec) of + #options{} = Rec -> + start(Rec, NameOpt, false); + {error, _} = No -> + No end. +%% make_opts/2 + +make_opts(KeyOrName, ExtraOptions) -> + SortedExtra = lists:keysort(1, ExtraOptions), + SortedConfig = lists:keysort(1, ct:get_config(KeyOrName, [])), + lists:ukeymerge(1, SortedConfig, SortedExtra). + %%---------------------------------------------------------------------- %% Close the given SSH connection. -spec disconnect(Conn) -> ok | {error,error_reason()} when @@ -300,146 +317,185 @@ disconnect(Conn) -> %%---------------------------------------------------------------------- %% Open a netconf session as a channel on the given SSH connection, %% and exchange `hello' messages. + +%% session/1 + -spec session(Conn) -> Result when Conn :: handle(), - Result :: {ok,handle()} | {error,error_reason()}. + Result :: {ok, handle()} | {error, error_reason()}. + session(Conn) -> - do_session(Conn,[],#options{type=channel},[]). + session(Conn, [], #options{type = channel}, []). --spec session(Conn,Options) -> Result when +%% session/2 + +-spec session(Conn, Options) -> Result when Conn :: handle(), - Options :: session_options(), - Result :: {ok,handle()} | {error,error_reason()}; - (KeyOrName,Conn) -> Result when + Options :: [session_option()], + Result :: {ok, handle()} | {error, error_reason()}; + (KeyOrName, Conn) -> Result when KeyOrName :: ct:key_or_name(), Conn :: handle(), - Result :: {ok,handle()} | {error,error_reason()}. -session(Conn,Options) when is_list(Options) -> - do_session(Conn,Options,#options{type=channel},[]); -session(KeyOrName,Conn) -> - do_session(Conn,[],#options{name=KeyOrName,type=channel},[{name,KeyOrName}]). + Result :: {ok, handle()} | {error, error_reason()}. + +session(Conn, Options) when is_list(Options) -> + session(Conn, Options, #options{type = channel}, []); --spec session(KeyOrName,Conn,Options) -> Result when +session(KeyOrName, Conn) -> + session(Conn, + [], + #options{name = KeyOrName, type = channel}, + [{name, KeyOrName}]). + +%% session/3 + +-spec session(KeyOrName, Conn, Options) -> Result when Conn :: handle(), - Options :: session_options(), + Options :: [session_option()], KeyOrName :: ct:key_or_name(), - Result :: {ok,handle()} | {error,error_reason()}. -session(KeyOrName,Conn,ExtraOptions) -> - SortedExtra = lists:keysort(1,ExtraOptions), - SortedConfig = lists:keysort(1,ct:get_config(KeyOrName,[])), - AllOpts = lists:ukeymerge(1,SortedConfig,SortedExtra), - do_session(Conn,AllOpts,#options{name=KeyOrName,type=channel}, - [{name,KeyOrName}]). - -do_session(Conn,OptList,InitOptRec,NameOpt) -> - case call(Conn,get_ssh_connection) of - {ok,SshConn} -> - case check_session_options(OptList,InitOptRec) of - {ok,Options} -> - case ct_gen_conn:start(SshConn,Options,?MODULE, - NameOpt ++ - [{reconnect,false}, - {use_existing_connection,false}, - {forward_messages,true}]) of - {ok,Client} -> - case hello(Client,Options#options.timeout) of - ok -> - {ok,Client}; - Error -> - Error - end; - Error -> - Error - end; - Error -> - Error - end; - Error -> - Error + Result :: {ok, handle()} | {error, error_reason()}. + +session(KeyOrName, Conn, ExtraOptions) -> + session(Conn, + make_opts(KeyOrName, ExtraOptions), + #options{name = KeyOrName, type = channel}, + [{name, KeyOrName}]). + +%% session/4 + +session(Conn, Opts, InitRec, NameOpt) -> + T = make_ref(), + try + [_ | {ok, SshConn}] = [T | call(Conn, get_ssh_connection)], + [_ | #options{} = Rec] = [T | make_session_options(Opts, InitRec)], + [_ | {ok, Client} = Ok] = [T | start(SshConn, Rec, NameOpt, true)], + [_ | ok] = [T | hello(Client, caps(Opts), Rec#options.timeout)], + Ok + catch + error: {badmatch, [T | Error]} -> + Error end. +%% caps/1 + +caps(Opts) -> + [T || {capability, _} = T <- Opts]. + %%---------------------------------------------------------------------- %% Open a netconf session and exchange 'hello' messages. %% If the server options are specified in a configuration file, use %% open/2. + +%% open/1 + -spec open(Options) -> Result when - Options :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + Options :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. + open(Options) -> - open(Options,#options{type=connection_and_channel},[],true). + open(Options, + #options{type = connection_and_channel}, + [], + true). --spec open(KeyOrName, ExtraOptions) -> Result when +-spec open(KeyOrName, ExtraOption) -> Result when KeyOrName :: ct:key_or_name(), - ExtraOptions :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + ExtraOption :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. + open(KeyOrName, ExtraOpts) -> open(KeyOrName, ExtraOpts, true). -open(KeyOrName, ExtraOpts, Hello) -> - SortedExtra = lists:keysort(1,ExtraOpts), - SortedConfig = lists:keysort(1,ct:get_config(KeyOrName,[])), - AllOpts = lists:ukeymerge(1,SortedConfig,SortedExtra), - open(AllOpts,#options{name=KeyOrName,type=connection_and_channel}, - [{name,KeyOrName}],Hello). - -open(OptList,InitOptRec,NameOpt,Hello) -> - case check_options(OptList,InitOptRec) of - {Host,Port,Options} -> - case ct_gen_conn:start({Host,Port},Options,?MODULE, - NameOpt ++ [{reconnect,false}, - {use_existing_connection,false}, - {forward_messages,true}]) of - {ok,Client} when Hello==true -> - case hello(Client,Options#options.timeout) of - ok -> - {ok,Client}; - Error -> - Error - end; - Other -> - Other - end; - Error -> - Error +%% open/3 + +open(KeyOrName, ExtraOptions, Hello) -> + open(make_opts(KeyOrName, ExtraOptions), + #options{name = KeyOrName, type = connection_and_channel}, + [{name, KeyOrName}], + Hello). + +%% open/4 + +open(Opts, InitRec, NameOpt, Hello) -> + T = make_ref(), + try + [_, #options{} = Rec] = [T, make_options(Opts, InitRec)], + [_, {ok, Client} = Ok | true] = [T, start(Rec, NameOpt, true) | Hello], + [_, ok] = [T, hello(Client, caps(Opts), Rec#options.timeout)], + Ok + catch + error: {badmatch, [T, Res | _]} -> + Res end. +%% start/3 + +start(#options{host = undefined}, _, _) -> + {error, no_host_address}; + +start(#options{port = undefined}, _, _) -> + {error, no_port}; + +start(#options{host = Host, port = Port} = Opts, NameOpt, Fwd) -> + start({Host, Port}, Opts, NameOpt, Fwd). + +%% start/4 + +start(Ep, Opts, NameOpt, Fwd) -> + ct_gen_conn:start(Ep, Opts, ?MODULE, [{reconnect, false}, + {use_existing_connection, false}, + {forward_messages, Fwd} + | NameOpt]). %%---------------------------------------------------------------------- -%% As open/1,2, except no 'hello' message is sent. +%% Like open/1,2, but no 'hello' message is sent. + -spec only_open(Options) -> Result when - Options :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + Options :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. + only_open(Options) -> - open(Options,#options{type=connection_and_channel},[],false). + open(Options, #options{type = connection_and_channel}, [], false). --spec only_open(KeyOrName,ExtraOptions) -> Result when +-spec only_open(KeyOrName, ExtraOptions) -> Result when KeyOrName :: ct:key_or_name(), - ExtraOptions :: options(), - Result :: {ok,handle()} | {error,error_reason()}. + ExtraOptions :: [option()], + Result :: {ok, handle()} | {error, error_reason()}. + only_open(KeyOrName, ExtraOpts) -> open(KeyOrName, ExtraOpts, false). %%---------------------------------------------------------------------- %% Send a 'hello' message. + +%% hello/1 + -spec hello(Client) -> Result when Client :: handle(), - Result :: ok | {error,error_reason()}. + Result :: ok | {error, error_reason()}. + hello(Client) -> - hello(Client,[],?DEFAULT_TIMEOUT). + hello(Client, [], ?DEFAULT_TIMEOUT). + +%% hello/2 --spec hello(Client,Timeout) -> Result when +-spec hello(Client, Timeout) -> Result when Client :: handle(), Timeout :: timeout(), - Result :: ok | {error,error_reason()}. -hello(Client,Timeout) -> - hello(Client,[],Timeout). + Result :: ok | {error, error_reason()}. + +hello(Client, Timeout) -> + hello(Client, [], Timeout). --spec hello(Client,Options,Timeout) -> Result when +%% hello/3 + +-spec hello(Client, Options, Timeout) -> Result when Client :: handle(), Options :: [{capability, [string()]}], Timeout :: timeout(), - Result :: ok | {error,error_reason()}. -hello(Client,Options,Timeout) -> + Result :: ok | {error, error_reason()}. + +hello(Client, Options, Timeout) -> call(Client, {hello, Options, Timeout}). @@ -675,117 +731,122 @@ action(Client,Action,Timeout) -> %%---------------------------------------------------------------------- %% Send a 'create-subscription' request %% See RFC5277, NETCONF Event Notifications --spec create_subscription(Client) -> Result when - Client :: client(), - Result :: ok | {error,error_reason()}. -create_subscription(Client) -> - create_subscription(Client,?DEFAULT_STREAM,?DEFAULT_TIMEOUT). --spec create_subscription(Client, Stream | Filter | Timeout) -> Result when +%% create_subscription/2 + +-spec create_subscription(Client, Values) -> Result when Client :: client(), + Values :: #{stream => Stream, + filter => Filter, + start => StartTime, + stop => StopTime}, Stream :: stream_name(), Filter :: simple_xml() | [simple_xml()], - Timeout :: timeout(), + StartTime :: xs_datetime(), + StopTime :: xs_datetime(), + Result :: ok | {error,error_reason()}; + %% historic, no longer documented + (Client, list() | timeout()) -> Result when + Client :: client(), Result :: ok | {error,error_reason()}. -create_subscription(Client,Timeout) + +create_subscription(Client, #{} = Values) -> + create_subscription(Client, Values, ?DEFAULT_TIMEOUT); + +%% historic clauses +create_subscription(Client, Timeout) when ?is_timeout(Timeout) -> - create_subscription(Client,?DEFAULT_STREAM,Timeout); -create_subscription(Client,Stream) + create_subscription(Client, #{}, Timeout); +create_subscription(Client, Stream) when ?is_string(Stream) -> - create_subscription(Client,Stream,?DEFAULT_TIMEOUT); -create_subscription(Client,Filter) + create_subscription(Client, #{stream => Stream}); +create_subscription(Client, Filter) when ?is_filter(Filter) -> - create_subscription(Client,?DEFAULT_STREAM,Filter, - ?DEFAULT_TIMEOUT). + create_subscription(Client, #{filter => Filter}). -create_subscription(Client,Stream,Timeout) - when ?is_string(Stream) andalso - ?is_timeout(Timeout) -> - call(Client,{send_rpc_op,{create_subscription,self()}, - [Stream,undefined,undefined,undefined], - Timeout}); -create_subscription(Client,StartTime,StopTime) - when ?is_string(StartTime) andalso - ?is_string(StopTime) -> - create_subscription(Client,?DEFAULT_STREAM,StartTime,StopTime, - ?DEFAULT_TIMEOUT); -create_subscription(Client,Filter,Timeout) - when ?is_filter(Filter) andalso - ?is_timeout(Timeout) -> - create_subscription(Client,?DEFAULT_STREAM,Filter,Timeout); -create_subscription(Client,Stream,Filter) - when ?is_string(Stream) andalso - ?is_filter(Filter) -> - create_subscription(Client,Stream,Filter,?DEFAULT_TIMEOUT). - -create_subscription(Client,StartTime,StopTime,Timeout) - when ?is_string(StartTime) andalso - ?is_string(StopTime) andalso - ?is_timeout(Timeout) -> - create_subscription(Client,?DEFAULT_STREAM,StartTime,StopTime,Timeout); -create_subscription(Client,Stream,StartTime,StopTime) - when ?is_string(Stream) andalso - ?is_string(StartTime) andalso - ?is_string(StopTime) -> - create_subscription(Client,Stream,StartTime,StopTime,?DEFAULT_TIMEOUT); -create_subscription(Client,Filter,StartTime,StopTime) - when ?is_filter(Filter) andalso - ?is_string(StartTime) andalso - ?is_string(StopTime) -> - create_subscription(Client,?DEFAULT_STREAM,Filter, - StartTime,StopTime,?DEFAULT_TIMEOUT); -create_subscription(Client,Stream,Filter,Timeout) - when ?is_string(Stream) andalso - ?is_filter(Filter) andalso - ?is_timeout(Timeout) -> - call(Client,{send_rpc_op,{create_subscription,self()}, - [Stream,Filter,undefined,undefined], - Timeout}). - --spec create_subscription(Client, Stream, StartTime, StopTime, Timeout) -> - Result when +-spec create_subscription(Client, Values, Timeout) -> Result when Client :: client(), + Values :: #{stream => Stream, + filter => Filter, + start => StartTime, + stop => StopTime}, Stream :: stream_name(), + Filter :: simple_xml() | [simple_xml()], StartTime :: xs_datetime(), StopTime :: xs_datetime(), Timeout :: timeout(), Result :: ok | {error,error_reason()}; - (Client, Stream, Filter,StartTime, StopTime) -> - Result when + %% historic, no longer documented + (Client, list(), list() | timeout()) -> Result when Client :: client(), - Stream :: stream_name(), - Filter :: simple_xml() | [simple_xml()], - StartTime :: xs_datetime(), - StopTime :: xs_datetime(), Result :: ok | {error,error_reason()}. -create_subscription(Client,Stream,StartTime,StopTime,Timeout) - when ?is_string(Stream) andalso - ?is_string(StartTime) andalso - ?is_string(StopTime) andalso + +create_subscription(Client, #{} = Values, Timeout) -> + Keys = [{stream, ?DEFAULT_STREAM}, + {filter, undefined}, + {start, undefined}, + {stop, undefined}], + call(Client, {send_rpc_op, {create_subscription, self()}, + [maps:get(K, Values, D) || {K,D} <- Keys], + Timeout}); + +%% historic clauses, arity 3 +create_subscription(Client, Stream, Timeout) + when ?is_string(Stream), ?is_timeout(Timeout) -> + create_subscription(Client, #{stream => Stream}, Timeout); +create_subscription(Client, StartTime, StopTime) + when ?is_string(StartTime), ?is_string(StopTime) -> + create_subscription(Client, #{start => StartTime, stop => StopTime}); +create_subscription(Client, Filter, Timeout) + when ?is_filter(Filter), ?is_timeout(Timeout) -> + create_subscription(Client, #{filter => Filter}, Timeout); +create_subscription(Client, Stream, Filter) + when ?is_string(Stream), ?is_filter(Filter) -> + create_subscription(Client, #{stream => Stream, filter => Filter}). + +%% historic clauses, arity 1,4-5 +create_subscription(Client) -> + create_subscription(Client, #{}). +create_subscription(Client, StartTime, StopTime, Timeout) + when ?is_string(StartTime), ?is_string(StopTime), ?is_timeout(Timeout) -> + Values = #{start => StartTime, + stop => StopTime}, + create_subscription(Client, Values, Timeout); +create_subscription(Client, Stream, StartTime, StopTime) + when ?is_string(Stream), ?is_string(StartTime), ?is_string(StopTime) -> + create_subscription(Client, #{stream => Stream, + start => StartTime, + stop => StopTime}); +create_subscription(Client, Filter, StartTime, StopTime) + when ?is_filter(Filter), ?is_string(StartTime), ?is_string(StopTime) -> + create_subscription(Client, #{filter => Filter, + start => StartTime, + stop => StopTime}); +create_subscription(Client, Stream, Filter, Timeout) + when ?is_string(Stream), ?is_filter(Filter), ?is_timeout(Timeout) -> + Values = #{stream => Stream, + filter => Filter}, + create_subscription(Client, Values, Timeout). +create_subscription(Client, Stream, StartTime, StopTime, Timeout) + when ?is_string(Stream), ?is_string(StartTime), ?is_string(StopTime), ?is_timeout(Timeout) -> - call(Client,{send_rpc_op,{create_subscription,self()}, - [Stream,undefined,StartTime,StopTime], - Timeout}); -create_subscription(Client,Stream,Filter,StartTime,StopTime) - when ?is_string(Stream) andalso - ?is_filter(Filter) andalso - ?is_string(StartTime) andalso + Values = #{stream => Stream, + start => StartTime, + stop => StopTime}, + create_subscription(Client, Values, Timeout); +create_subscription(Client, Stream, Filter, StartTime, StopTime) + when ?is_string(Stream), ?is_filter(Filter), ?is_string(StartTime), ?is_string(StopTime) -> - create_subscription(Client,Stream,Filter,StartTime,StopTime,?DEFAULT_TIMEOUT). - --spec create_subscription(Client, Stream, Filter,StartTime, StopTime, Timeout) -> - Result when - Client :: client(), - Stream :: stream_name(), - Filter :: simple_xml() | [simple_xml()], - StartTime :: xs_datetime(), - StopTime :: xs_datetime(), - Timeout :: timeout(), - Result :: ok | {error,error_reason()}. -create_subscription(Client,Stream,Filter,StartTime,StopTime,Timeout) -> - call(Client,{send_rpc_op,{create_subscription, self()}, - [Stream,Filter,StartTime,StopTime], - Timeout}). + create_subscription(Client, #{stream => Stream, + filter => Filter, + start => StartTime, + stop => StopTime}). +create_subscription(Client, Stream, Filter, StartTime, StopTime, Timeout) -> + Values = #{stream => Stream, + filter => Filter, + start => StartTime, + stop => StopTime}, + create_subscription(Client, Values, Timeout). %%---------------------------------------------------------------------- %% Send a request to get the given event streams @@ -859,6 +920,8 @@ kill_session(Client, SessionId, Timeout) -> %% Callback functions %%---------------------------------------------------------------------- +%% init/3 + init(_KeyOrName,{CM,{Host,Port}},Options) -> case ssh_channel(#connection{reference=CM,host=Host,port=Port},Options) of {ok,Connection} -> @@ -883,29 +946,32 @@ init(_KeyOrName,{_Host,_Port},Options) -> {error,Reason} end. +%% terminate/2 terminate(_, #state{connection=Connection}) -> ssh_close(Connection), ok. -handle_msg({hello, Options, Timeout}, From, - #state{connection=Connection,hello_status=HelloStatus} = State) -> +%% handle_msg/3 + +%% Send hello and return to the caller only after reception of the +%% server's hello. +handle_msg({hello, Options, Timeout}, + From, + #state{connection = Connection, + hello_status = HelloStatus} + = State) -> case do_send(Connection, client_hello(Options)) of - ok -> - case HelloStatus of - undefined -> - {Ref,TRef} = set_request_timer(Timeout), - {noreply, State#state{hello_status=#pending{tref=TRef, - ref=Ref, - caller=From}}}; - received -> - {reply, ok, State#state{hello_status=done}}; - {error,Reason} -> - {stop, {error,Reason}, State} - end; - Error -> + ok when HelloStatus == undefined -> %% server hello not yet received + TRef = set_request_timer(Timeout, hello), + {noreply, State#state{hello_status = #pending{tref = TRef, + caller = From}}}; + ok -> %% or yes: negotiate version + handle_capx(State); + Error -> {stop, Error, State} end; + handle_msg(get_ssh_connection, _From, #state{connection=Connection}=State) -> Reply = case Connection#connection.reference of @@ -914,29 +980,40 @@ handle_msg(get_ssh_connection, _From, #state{connection=Connection}=State) -> Connection#connection.port}}} end, {reply, Reply, State}; -handle_msg(_, _From, #state{session_id=undefined} = State) -> - %% Hello is not yet excanged - this shall never happen - {reply,{error,waiting_for_hello},State}; + +%% Request before server hello. Possible with only_open, since a +%% handle is then returned without waiting for the server. +handle_msg(_, _From, #state{session_id = undefined} = State) -> + {reply, {error, waiting_for_hello}, State}; + handle_msg(get_capabilities, _From, #state{capabilities = Caps} = State) -> {reply, Caps, State}; + handle_msg(get_session_id, _From, #state{session_id = Id} = State) -> {reply, Id, State}; -handle_msg({send, Timeout, SimpleXml}, From, - #state{connection=Connection,pending=Pending} = State) -> + +handle_msg({send, Timeout, SimpleXml}, + From, + #state{connection = Connection, + pending = Pending} + = State) -> case do_send(Connection, SimpleXml) of - ok -> - {Ref,TRef} = set_request_timer(Timeout), - {noreply, State#state{pending=[#pending{tref=TRef, - ref=Ref, - caller=From} | Pending]}}; - Error -> - {reply, Error, State} + ok -> + TRef = set_request_timer(Timeout, send), + {noreply, State#state{pending = [#pending{tref = TRef, + caller = From} + | Pending]}}; + Error -> + {reply, Error, State} end; + handle_msg({send_rpc, SimpleXml, Timeout}, From, State) -> do_send_rpc(undefined, SimpleXml, Timeout, From, State); + handle_msg({send_rpc_op, Op, Data, Timeout}, From, State) -> SimpleXml = encode_rpc_operation(Op,Data), do_send_rpc(Op, SimpleXml, Timeout, From, State); + handle_msg({get_event_streams=Op,Streams,Timeout}, From, State) -> Filter = {netconf,?NETMOD_NOTIF_NAMESPACE_ATTR, [{streams,[{stream,[{name,[Name]}]} || Name <- Streams]}]}, @@ -945,7 +1022,9 @@ handle_msg({get_event_streams=Op,Streams,Timeout}, From, State) -> handle_msg({ssh_cm, CM, {data, Ch, _Type, Data}}, State) -> ssh_connection:adjust_window(CM,Ch,size(Data)), + log(State#state.connection, recv, Data), handle_data(Data, State); + handle_msg({ssh_cm, _CM, _SshCloseMsg}, State) -> %% _SshCloseMsg can probably be one of %% {eof,Ch} @@ -962,21 +1041,29 @@ handle_msg({ssh_cm, _CM, _SshCloseMsg}, State) -> %%! connection - due to terminate/2 {stop, State}; -handle_msg({Ref,timeout}, - #state{hello_status=#pending{ref=Ref,caller=Caller}} = State) -> - ct_gen_conn:return(Caller,{error,{hello_session_failed,timeout}}), - {stop,State#state{hello_status={error,timeout}}}; -handle_msg({Ref,timeout},#state{pending=Pending} = State) -> - {value,#pending{op=Op,caller=Caller},Pending1} = - lists:keytake(Ref,#pending.ref,Pending), - ct_gen_conn:return(Caller,{error,timeout}), - R = case Op of - close_session -> stop; - _ -> noreply - end, - %% Halfhearted try to get in correct state, this matches - %% the implementation before this patch - {R,State#state{pending=Pending1, no_end_tag_buff= <<>>, buff= <<>>}}. + +handle_msg({timeout, TRef, hello}, + #state{hello_status = #pending{tref = TRef, + caller = From}} + = State) -> + ct_gen_conn:return(From, {error, {hello_session_failed, timeout}}), + {stop, State#state{hello_status = {error,timeout}}}; + +handle_msg({timeout, TRef, Op}, #state{pending = Pending} = State) -> + case lists:keytake(TRef, #pending.tref, Pending) of + {value, #pending{caller = From}, Rest} -> + ct_gen_conn:return(From, {error, timeout}), + %% Discard received bytes in hope that the server has sent + %% an incomplete message. Otherwise this is doomed to + %% leave the connection in an unusable state. + {if Op == close_session -> stop; true -> noreply end, + State#state{pending = Rest, + buf = is_binary(State#state.buf)}}; + false -> + {noreply, State} + end. + +%% close/1 %% Called by ct_util_server to close registered connections before terminate. close(Client) -> @@ -1048,63 +1135,163 @@ get_handle(Client) -> Error end. -check_options(OptList,Options) -> - check_options(OptList,undefined,undefined,Options). +%% make_options/2 -check_options([], undefined, _Port, _Options) -> - {error, no_host_address}; -check_options([], _Host, undefined, _Options) -> - {error, no_port}; -check_options([], Host, Port, Options) -> - {Host,Port,Options}; -check_options([{ssh, Host}|T], _, Port, Options) -> - check_options(T, Host, Port, Options#options{host=Host}); -check_options([{port,Port}|T], Host, _, Options) -> - check_options(T, Host, Port, Options#options{port=Port}); -check_options([{timeout, Timeout}|T], Host, Port, Options) - when is_integer(Timeout); Timeout==infinity -> - check_options(T, Host, Port, Options#options{timeout = Timeout}); -check_options([{timeout, _} = Opt|_T], _Host, _Port, _Options) -> - {error, {invalid_option, Opt}}; -check_options([Opt|T], Host, Port, #options{ssh=SshOpts}=Options) -> - %% Option verified by ssh - check_options(T, Host, Port, Options#options{ssh=[Opt|SshOpts]}). - -check_session_options([],Options) -> - {ok,Options}; -check_session_options([{timeout, Timeout}|T], Options) - when is_integer(Timeout); Timeout==infinity -> - check_session_options(T, Options#options{timeout = Timeout}); -check_session_options([Opt|_T], _Options) -> - {error, {invalid_option, Opt}}. +make_options(Opts, Rec) -> + make_options(Opts, Rec#options{port = undefined}, fun opt/2). + +opt({T, Host}, Rec) + when T == ssh; + T == host -> + Rec#options{host = Host}; + +opt({port, Port}, Rec) -> + Rec#options{port = Port}; + +opt({timeout, Tmo}, Rec) + when is_integer(Tmo); + Tmo == infinity -> + Rec#options{timeout = Tmo}; + +opt({timeout, _} = T, _) -> + throw(T); + +opt({capability, _}, Rec) -> + Rec; + +opt(Opt, #options{ssh = Opts} = Rec) -> %% option verified by ssh + Rec#options{ssh = [Opt | Opts]}. + +%% make_session_options/2 + +make_session_options(Opts, Rec) -> + make_options(Opts, Rec, fun session_opt/2). + +session_opt({capability, _}, Rec) -> + Rec; + +session_opt({timeout, Tmo}, Rec) + when is_integer(Tmo); + Tmo == infinity -> + Rec#options{timeout = Tmo}; +session_opt(T, _Rec) -> + throw(T). + +%% make_options/3 + +make_options(Opts, Rec, F) -> + try + #options{} = lists:foldl(F, Rec, Opts) + catch + T -> + {error, {invalid_option, T}} + end. %%%----------------------------------------------------------------- -set_request_timer(infinity) -> - {undefined,undefined}; -set_request_timer(T) -> - Ref = make_ref(), - {ok,TRef} = timer:send_after(T,{Ref,timeout}), - {Ref,TRef}. + +set_request_timer(infinity, _) -> + false; + +set_request_timer(Tmo, Op) -> + erlang:start_timer(Tmo, self(), Op). %%%----------------------------------------------------------------- -cancel_request_timer(undefined,undefined) -> + +cancel_request_timer(false) -> ok; -cancel_request_timer(Ref,TRef) -> - _ = timer:cancel(TRef), - receive {Ref,timeout} -> ok - after 0 -> ok - end. + +cancel_request_timer(TRef) -> + erlang:cancel_timer(TRef). %%%----------------------------------------------------------------- -client_hello(Options) when is_list(Options) -> - UserCaps = [{capability, UserCap} || - {capability, UserCap} <- Options, - is_list(hd(UserCap))], - {hello, ?NETCONF_NAMESPACE_ATTR, - [{capabilities, - [{capability,[?NETCONF_BASE_CAP++?NETCONF_BASE_CAP_VSN]}| - UserCaps]}]}. + +%% client_hello/1 +%% +%% Prepend the 1.0 base capability only if none is specified by the +%% user. Store the versions in the process dictionary until they're +%% examined upon reception of server capabilities in handle_capx/1. + +client_hello(Opts) + when is_list(Opts) -> + UserCaps = [{T, cap(lists:flatten(Cs))} || {capability = T, Cs} <- Opts], + Vsns = versions(UserCaps), + put(?KEY(protocol_vsn), Vsns), + {hello, + ?NETCONF_NAMESPACE_ATTR, + [{capabilities, [{capability, [?NETCONF_BASE_CAP, ?NETCONF_BASE_CAP_VSN]} + || [] == Vsns] + ++ UserCaps}]}. + +%% cap/1 +%% +%% Let NETCONF capabilities be specified in the shorthand documented in +%% RFC 6241. + +%% This shorthand is documented in RFC 6241 10.4 NETCONF Capabilities +%% URNS, but not in 8 Capabilities. +cap(":base:" ++ _ = Str) -> + ["urn:ietf:params:netconf", Str]; + +cap([$:|_] = Str) -> + ["urn:ietf:params:netconf:capability", Str]; + +cap(Str) -> + [Str]. + +%% versions/1 +%% +%% Extract base protocol versions from capability options. + +versions(Opts) -> + [V || {capability, L} <- Opts, + S <- L, + ?NETCONF_BASE_CAP ++ X <- [lists:flatten(S)], + V <- [lists:takewhile(fun(C) -> C /= $? end, X)]]. + +%% handle_capx/1 +%% +%% Ignore parameters as RFC 6241 (NETCONF 1.1) requires in 8.1 +%% Capabilities Exchange. Be overly lenient with whitespace since RFC +%% 6241 gives examples with significant trailing whitespace. + +handle_capx(#state{hello_status = received, capabilities = Caps} = S) -> + Remote = [V || ?NETCONF_BASE_CAP ++ X <- Caps, + [V|_] <- [string:lexemes(X, "? \t\r\n")]], + Local = erase(?KEY(protocol_vsn)), + case protocol_vsn(Local, Remote) of + false when Remote == [] -> + Reason = {incorrect_hello, no_base_capability_found}, + {stop, {error, Reason}, S}; + false -> + Reason = {incompatible_base_capability_vsn, lists:min(Remote)}, + {stop, {error, Reason}, S}; + Vsn -> + put(?KEY(chunk), Vsn /= "1.0"), + {reply, ok, rebuf(Vsn, S#state{hello_status = Vsn})} + end; + +handle_capx(#state{hello_status = {error, _} = No} = S) -> + {stop, No, S}. + +%% rebuf/2 +%% +%% Turn the message buffer into a list for 1.1 chunking if the +%% negotiated protocol version is > 1.0. + +rebuf("1.0", S) -> + S; + +rebuf(_, #state{buf = Bin} = S) -> + S#state{buf = [Bin, 3]}. + +%% protocol_vsn/2 + +protocol_vsn([], Vsns) -> + protocol_vsn(["1.0"], Vsns); + +protocol_vsn(Local, Remote) -> + lists:max([false | [V || V <- Remote, lists:member(V, Local)]]). %%%----------------------------------------------------------------- @@ -1150,111 +1337,130 @@ maybe_element(Tag,Value) -> %%%----------------------------------------------------------------- %%% Send XML data to server -do_send_rpc(PendingOp,SimpleXml,Timeout,Caller, - #state{connection=Connection,msg_id=MsgId,pending=Pending} = State) -> - case do_send_rpc(Connection, MsgId, SimpleXml) of - ok -> - {Ref,TRef} = set_request_timer(Timeout), - {noreply, State#state{msg_id=MsgId+1, - pending=[#pending{tref=TRef, - ref=Ref, - msg_id=MsgId, - op=PendingOp, - caller=Caller} | Pending]}}; - Error -> - {reply, Error, State#state{msg_id=MsgId+1}} +do_send_rpc(Op, SimpleXml, Timeout, Caller, #state{connection = Connection, + msg_id = MsgId, + pending = Pending} + = State) -> + Msg = {rpc, + [{'message-id', MsgId} | ?NETCONF_NAMESPACE_ATTR], + [SimpleXml]}, + Next = MsgId + 1, + case do_send(Connection, Msg) of + ok -> + TRef = set_request_timer(Timeout, Op), + Rec = #pending{tref = TRef, + msg_id = MsgId, + op = Op, + caller = Caller}, + {noreply, State#state{msg_id = Next, + pending = [Rec | Pending]}}; + Error -> + {reply, Error, State#state{msg_id = Next}} end. -do_send_rpc(Connection, MsgId, SimpleXml) -> - do_send(Connection, - {rpc, - [{'message-id',MsgId} | ?NETCONF_NAMESPACE_ATTR], - [SimpleXml]}). +do_send(Connection, Simple) -> + ssh_send(Connection, frame(to_xml(Simple))). -do_send(Connection, SimpleXml) -> - Xml=to_xml_doc(SimpleXml), - ssh_send(Connection, Xml). - -to_xml_doc(Simple) -> +to_xml(Simple) -> Prolog = "<?xml version=\"1.0\" encoding=\"UTF-8\"?>", - Xml = unicode:characters_to_binary( - xmerl:export_simple([Simple], - xmerl_xml, - [#xmlAttribute{name=prolog, - value=Prolog}])), - <<Xml/binary,?END_TAG/binary>>. + Chars = xmerl:export_simple([Simple], + xmerl_xml, + [#xmlAttribute{name = prolog, + value = Prolog}]), + unicode:characters_to_binary(Chars). + +%% frame/1 + +frame(Bin) -> + case get(?KEY(chunk)) of + true -> %% 1.1 chunking + [chunk(Bin) | "\n##\n"]; + _ -> %% 1.0 framing + [Bin | ?END_TAG] + end. + +%% chunk/1 +%% +%% Chunk randomly to exercise the server. + +chunk(<<>>) -> + []; + +chunk(Bin) -> + Sz = min(rand:uniform(1024), size(Bin)), + <<B:Sz/binary, Rest/binary>> = Bin, + ["\n#", integer_to_list(Sz), $\n, B | chunk(Rest)]. %%%----------------------------------------------------------------- %%% Parse and handle received XML data -%%% Two buffers are used: -%%% * 'no_end_tag_buff' contains data that is checked and does not -%%% contain any (part of an) end tag. -%%% * 'buff' contains all other saved data - it may or may not -%%% include (a part of) an end tag. -%%% The reason for this is to avoid running binary:split/3 multiple -%%% times on the same data when it does not contain an end tag. This -%%% can be a considerable optimation in the case when a lot of data is -%%% received (e.g. when fetching all data from a node) and the data is -%%% sent in multiple ssh packages. -handle_data(NewData,#state{connection=Connection} = State0) -> - log(Connection,recv,NewData), - NoEndTag0 = State0#state.no_end_tag_buff, - Buff0 = State0#state.buff, - Data = <<Buff0/binary, NewData/binary>>, - case binary:split(Data,?END_TAG,[]) of - [_NoEndTagFound] -> - NoEndTagSize = case byte_size(Data) of - Sz when Sz<5 -> 0; - Sz -> Sz-5 - end, - <<NoEndTag1:NoEndTagSize/binary,Buff/binary>> = Data, - NoEndTag = <<NoEndTag0/binary,NoEndTag1/binary>>, - {noreply, State0#state{no_end_tag_buff=NoEndTag, buff=Buff}}; - [FirstMsg0,Buff1] -> - FirstMsg = remove_initial_nl(<<NoEndTag0/binary,FirstMsg0/binary>>), - SaxArgs = [{event_fun,fun sax_event/3}, {event_state,[]}], - case xmerl_sax_parser:stream(FirstMsg, SaxArgs) of - {ok, Simple, _Thrash} -> - case decode(Simple, State0#state{no_end_tag_buff= <<>>, - buff=Buff1}) of - {noreply, #state{buff=Buff} = State} when Buff =/= <<>> -> - %% Recurse if we have more data in buffer - handle_data(<<>>, State); - Other -> - Other - end; - {fatal_error,_Loc,Reason,_EndTags,_EventState} -> - ?error(Connection#connection.name, - [{parse_error,Reason}, - {buffer, Buff0}, - {new_data,NewData}]), - handle_error(Reason, State0#state{no_end_tag_buff= <<>>, - buff= <<>>}) - end + +handle_data(Bin, #state{buf = Head} = S) -> + case recv(Bin, Head) of + {error, Reason} -> + Conn = S#state.connection, + ?error(Conn#connection.name, [{receive_error, Reason}, + {buffer, Head}, + {bytes, Bin}]), + {stop, S}; + {Bytes, Rest} -> + handle_more(Rest, handle_xml(Bytes, S)); + Buf -> + {noreply, S#state{buf = Buf}} end. +%% handle_more/2 + +handle_more(_, {stop, _} = No) -> + No; + +handle_more(Bin, {noreply, State}) -> + handle_data(Bin, State#state{buf = true == get(?KEY(chunk))}). + +%% handle_xml/2 + +handle_xml(Bytes, State) -> + case parse(Bytes) of + {ok, Simple, _Rest} -> %% ignore trailing bytes + decode(Simple, State); + {fatal_error,_Loc,Reason,_EndTags,_EventState} -> + Conn = State#state.connection, + ?error(Conn#connection.name, [{parse_error, Reason}, + {message, Bytes}]), + {noreply, handle_error(Reason, State)} + end. + +%% parse/1 + +parse(Bytes) -> + xmerl_sax_parser:stream(<<>>, [{event_fun, fun sax_event/3}, + {event_state, []}, + {continuation_fun, fun cont/1}, + {continuation_state, Bytes}]). + +%% cont/1 -%% xml does not accept a leading nl and some netconf server add a nl after -%% each ?END_TAG, ignore them -remove_initial_nl(<<"\n", Data/binary>>) -> - remove_initial_nl(Data); -remove_initial_nl(Data) -> - Data. - -handle_error(Reason, State) -> - Pending1 = case State#state.pending of - [] -> []; - Pending -> - %% Assuming the first request gets the - %% first answer - P=#pending{tref=TRef,ref=Ref,caller=Caller} = - lists:last(Pending), - cancel_request_timer(Ref,TRef), - Reason1 = {failed_to_parse_received_data,Reason}, - ct_gen_conn:return(Caller,{error,Reason1}), - lists:delete(P,Pending) - end, - {noreply, State#state{pending=Pending1}}. +cont([] = No) -> + {<<>>, No}; + +cont([Bin | Rest]) -> + {Bin, Rest}; + +cont(Bin) -> + {Bin, <<>>}. + +%% handle_error/2 + +handle_error(_Reason, #state{pending = []} = State) -> + State; + +handle_error(Reason, #state{pending = Pending} = State) -> + %% Assuming the first request gets the first answer. + Rec = #pending{tref = TRef, + caller = Caller} + = lists:last(Pending), + cancel_request_timer(TRef), + ct_gen_conn:return(Caller,{error, {failed_to_parse_received_data, Reason}}), + State#state{pending = lists:delete(Rec, Pending)}. %% Event function for the sax parser. It builds a simple XML structure. %% Care is taken to keep namespace attributes and prefixes as in the original XML. @@ -1305,136 +1511,180 @@ parse_attrs([]) -> %%%----------------------------------------------------------------- -%%% Decoding of parsed XML data -decode({Tag,Attrs,_}=E, #state{connection=Connection,pending=Pending}=State) -> - ConnName = Connection#connection.name, - case get_local_name_atom(Tag) of - 'rpc-reply' -> - case get_msg_id(Attrs) of - undefined -> - case Pending of - [#pending{msg_id=MsgId}] -> - ?error(ConnName,[{warning,rpc_reply_missing_msg_id}, - {assuming,MsgId}]), - decode_rpc_reply(MsgId,E,State); - _ -> - ?error(ConnName,[{error,rpc_reply_missing_msg_id}]), - {noreply,State} - end; - MsgId -> - decode_rpc_reply(MsgId,E,State) - end; - hello -> - case State#state.hello_status of - undefined -> - case decode_hello(E) of - {ok,SessionId,Capabilities} -> - {noreply,State#state{session_id = SessionId, - capabilities = Capabilities, - hello_status = received}}; - {error,Reason} -> - {noreply,State#state{hello_status = {error,Reason}}} - end; - #pending{tref=TRef,ref=Ref,caller=Caller} -> - cancel_request_timer(Ref,TRef), - case decode_hello(E) of - {ok,SessionId,Capabilities} -> - ct_gen_conn:return(Caller,ok), - {noreply,State#state{session_id = SessionId, - capabilities = Capabilities, - hello_status = done}}; - {error,Reason} -> - ct_gen_conn:return(Caller,{error,Reason}), - {stop,State#state{hello_status={error,Reason}}} - end; - Other -> - ?error(ConnName,[{got_unexpected_hello,E}, - {hello_status,Other}]), - {noreply,State} - end; - notification -> - EventReceiver = State#state.event_receiver, - EventReceiver ! E, - {noreply,State}; - Other -> - %% Result of send/2, when not sending an rpc request - or - %% if netconf server sends noise. Can handle this only if - %% there is just one pending that matches (i.e. has - %% undefined msg_id and op) - case [P || P = #pending{msg_id=undefined,op=undefined} <- Pending] of - [#pending{tref=TRef,ref=Ref,caller=Caller}] -> - cancel_request_timer(Ref,TRef), - ct_gen_conn:return(Caller,E), - {noreply,State#state{pending=[]}}; - _ -> - ?error(ConnName,[{got_unexpected_msg,Other}, - {expecting,Pending}]), - {noreply,State} - end +%% decode/2 +%% +%% Decode parsed (incoming) XML. + +decode({Tag, _, _} = E, #state{} = State) -> + case decode(get_local_name_atom(Tag), E, State) of + #state{} = S -> + {noreply, S}; + {stop, #state{}} = T -> + T + end. + +%% decode/3 + +decode('rpc-reply', {_, Attrs, _} = E, State) -> + decode_rpc_reply(get_msg_id(Attrs), E, State); + +%% Incoming hello, outgoing not yet sent. +decode(hello, E, #state{hello_status = undefined} = State) -> + case decode_hello(E) of + {ok, SessionId, Capabilities} -> + State#state{session_id = SessionId, + capabilities = Capabilities, + hello_status = received}; + {error, _Reason} = No -> + State#state{hello_status = No} + end; + +%% Incoming hello, outgoing already sent: negotiate protocol version. +decode(hello, E, #state{hello_status = #pending{tref = TRef, + caller = From}} + = State) -> + cancel_request_timer(TRef), + case decode_hello(E) of + {ok, SessionId, Capabilities} -> + reply(From, handle_capx(State#state{session_id = SessionId, + capabilities = Capabilities, + hello_status = received})); + {error, _Reason} = No -> + ct_gen_conn:return(From, No), + {stop, State#state{hello_status = No}} + end; + +%% Duplicate hello: ignore. +decode(hello, E, #state{hello_status = Other} = State) -> + ConnName = (State#state.connection)#connection.name, + ?error(ConnName, [{got_unexpected_hello, E}, + {hello_status, Other}]), + State; + +decode(notification, E, State) -> + State#state.event_receiver ! E, + State; + +decode(Other, E, State) -> + decode_send({got_unexpected_msg, Other}, E, State). + +%% reply/2 +%% +%% Explicitly send a reply that can't be returned. + +reply(From, {T, Res, State}) -> + ct_gen_conn:return(From, Res), + case T of + reply -> + State; + stop -> + {T, State} end. +%% get_msg_id/1 + get_msg_id(Attrs) -> - case lists:keyfind('message-id',1,Attrs) of - {_,Str} -> - list_to_integer(Str); - false -> - undefined + case find('message-id', Attrs) of + {_,Str} -> + list_to_integer(Str); + false -> + undefined end. -decode_rpc_reply(MsgId,{_,Attrs,Content0}=E,#state{pending=Pending} = State) -> - case lists:keytake(MsgId,#pending.msg_id,Pending) of - {value, #pending{tref=TRef,ref=Ref,op=Op,caller=Caller}, Pending1} -> - cancel_request_timer(Ref,TRef), - Content = forward_xmlns_attr(Attrs,Content0), - {CallerReply,{ServerReply,State2}} = - do_decode_rpc_reply(Op,Content,State#state{pending=Pending1}), - ct_gen_conn:return(Caller,CallerReply), - {ServerReply,State2}; - false -> - %% Result of send/2, when receiving a correct - %% rpc-reply. Can handle this only if there is just one - %% pending that matches (i.e. has undefined msg_id and op) - case [P || P = #pending{msg_id=undefined,op=undefined} <- Pending] of - [#pending{tref=TRef, - ref=Ref, - msg_id=undefined, - op=undefined, - caller=Caller}] -> - cancel_request_timer(Ref,TRef), - ct_gen_conn:return(Caller,E), - {noreply,State#state{pending=[]}}; - _ -> - ConnName = (State#state.connection)#connection.name, - ?error(ConnName,[{got_unexpected_msg_id,MsgId}, - {expecting,Pending}]), - {noreply,State} - end +%% recode_rpc_reply/3 + +decode_rpc_reply(undefined, E, #state{pending = [#pending{msg_id = MsgId}]} + = State) + when MsgId /= undefined -> + ConnName = (State#state.connection)#connection.name, + ?error(ConnName, [{warning, rpc_reply_missing_msg_id}, + {assuming, MsgId}]), + decode_rpc_reply(MsgId, E, State); + +decode_rpc_reply(undefined, _, State) -> + ConnName = (State#state.connection)#connection.name, + ?error(ConnName, [{error, rpc_reply_missing_msg_id}]), + State; + +decode_rpc_reply(MsgId, + {_, Attrs, Content0} + = E, + #state{pending = Pending} + = State) -> + case lists:keytake(MsgId, #pending.msg_id, Pending) of + {value, Rec, Rest} -> + #pending{tref = TRef, op = Op, caller = From} + = Rec, + cancel_request_timer(TRef), + Content = forward_xmlns_attr(Attrs, Content0), + {Reply, T} = do_decode_rpc_reply(Op, + Content, + State#state{pending = Rest}), + ct_gen_conn:return(From, Reply), + T; + false -> %% not a send_rcp or server has sent wrong id + decode_send({got_unexpected_msg_id, MsgId}, E, State) + end. + +%% decode_send/2 +%% +%% Result of send/2,3. Only handle one at a time there since all +%% pendings have msg_id = undefined. + +decode_send(ErrorT, Elem, #state{pending = Pending} = State) -> + case [P || #pending{msg_id = undefined} = P <- Pending] of + [Rec] -> + #pending{tref = TRef, + caller = From} + = Rec, + cancel_request_timer(TRef), + ct_gen_conn:return(From, Elem), + State#state{pending = lists:delete(Rec, Pending)}; + _ -> + Conn = State#state.connection, + ?error(Conn#connection.name, [ErrorT, {expecting, Pending}]), + State end. -do_decode_rpc_reply(Op,Result,State) - when Op==lock; Op==unlock; Op==edit_config; Op==delete_config; - Op==copy_config; Op==kill_session -> - {decode_ok(Result),{noreply,State}}; -do_decode_rpc_reply(Op,Result,State) - when Op==get; Op==get_config; Op==action -> - {decode_data(Result),{noreply,State}}; -do_decode_rpc_reply(close_session,Result,State) -> +%% do_decode_rpc_reply/3 + +do_decode_rpc_reply(Op, Result, State) + when Op == lock; + Op == unlock; + Op == edit_config; + Op == delete_config; + Op == copy_config; + Op == kill_session -> + {decode_ok(Result), State}; + +do_decode_rpc_reply(Op, Result, State) + when Op == get; + Op == get_config; + Op == action -> + {decode_data(Result), State}; + +do_decode_rpc_reply(close_session, Result, State) -> case decode_ok(Result) of - ok -> {ok,{stop,State}}; - Other -> {Other,{noreply,State}} + ok -> + {ok, {stop, State}}; + Other -> + {Other, State} end; -do_decode_rpc_reply({create_subscription,Caller},Result,State) -> + +do_decode_rpc_reply({create_subscription, From}, Result, State) -> case decode_ok(Result) of - ok -> - {ok,{noreply,State#state{event_receiver=Caller}}}; - Other -> - {Other,{noreply,State}} + ok -> + {ok, State#state{event_receiver = From}}; + Other -> + {Other, State} end; -do_decode_rpc_reply(get_event_streams,Result,State) -> - {decode_streams(decode_data(Result)),{noreply,State}}; -do_decode_rpc_reply(undefined,Result,State) -> - {Result,{noreply,State}}. + +do_decode_rpc_reply(get_event_streams, Result, State) -> + {decode_streams(decode_data(Result)), State}; + +do_decode_rpc_reply(undefined, Result, State) -> + {Result, State}. @@ -1454,7 +1704,7 @@ decode_data([{Tag,Attrs,Content}]) -> case get_local_name_atom(Tag) of ok -> %% when action has return type void - ok; + ok; data -> %% Since content of data has nothing from the netconf %% namespace, we remove the parent's xmlns attribute here @@ -1525,41 +1775,43 @@ get_all_xmlns_attrs([{Key,_}=Attr|Attrs],XmlnsAttrs) -> get_all_xmlns_attrs([],XmlnsAttrs) -> XmlnsAttrs. - %% Decode server hello to pick out session id and capabilities -decode_hello({hello,_Attrs,Hello}) -> - case lists:keyfind('session-id',1,Hello) of - {'session-id',_,[SessionId]} -> - case lists:keyfind(capabilities,1,Hello) of - {capabilities,_,Capabilities} -> - case decode_caps(Capabilities,[],false) of - {ok,Caps} -> - {ok,list_to_integer(SessionId),Caps}; - Error -> - Error - end; - false -> - {error,{incorrect_hello,capabilities_not_found}} - end; - false -> - {error,{incorrect_hello,no_session_id_found}} +decode_hello({hello, _Attrs, Hello}) -> + U = make_ref(), + try + [{'session-id', _, [SessionId]}, _ | _] + = [find('session-id', Hello), no_session_id_found | U], + [{ok, Id}, _ | _] + = [catch {ok, list_to_integer(SessionId)}, invalid_session_id | U], + [true, _ | _] + = [0 < Id, invalid_session_id | U], + [{capabilities, _, Capabilities}, _ | _] + = [find(capabilities, Hello), capabilities_not_found | U], + [{ok, Caps}, _ | _] + = [decode_caps(Capabilities, [], false), false | U], + {ok, Id, Caps} + catch + error: {badmatch, [Error, false | U]} -> + Error; + error: {badmatch, [_, Reason | U]} -> + {error, {incorrect_hello, Reason}} end. -decode_caps([{capability,[],[?NETCONF_BASE_CAP++Vsn=Cap]} |Caps], Acc, _) -> - case Vsn of - ?NETCONF_BASE_CAP_VSN -> - decode_caps(Caps, [Cap|Acc], true); - _ -> - {error,{incompatible_base_capability_vsn,Vsn}} - end; -decode_caps([{capability,[],[Cap]}|Caps],Acc,Base) -> - decode_caps(Caps,[Cap|Acc],Base); -decode_caps([H|_T],_,_) -> - {error,{unexpected_capability_element,H}}; -decode_caps([],_,false) -> - {error,{incorrect_hello,no_base_capability_found}}; -decode_caps([],Acc,true) -> - {ok,lists:reverse(Acc)}. +find(Key, List) -> + lists:keyfind(Key, 1, List). + +decode_caps([{capability, [], [?NETCONF_BASE_CAP ++ _ = Cap]} | Caps], + Acc, + _) -> + decode_caps(Caps, [Cap|Acc], true); +decode_caps([{capability, [], [Cap]} | Caps], Acc, Base) -> + decode_caps(Caps, [Cap|Acc], Base); +decode_caps([H|_], _, _) -> + {error, {unexpected_capability_element, H}}; +decode_caps([], _, false) -> + {error, {incorrect_hello, no_base_capability_found}}; +decode_caps([], Acc, true) -> + {ok, lists:reverse(Acc)}. %% Return a list of {Name,Data}, where data is a {Tag,Value} list for each stream @@ -1570,7 +1822,7 @@ decode_streams({ok,[{netconf,_,Streams}]}) -> decode_streams([{streams,_,Streams}]) -> decode_streams(Streams); decode_streams([{stream,_,Stream} | Streams]) -> - {name,_,[Name]} = lists:keyfind(name,1,Stream), + {name,_,[Name]} = find(name, Stream), [{Name,[{Tag,Value} || {Tag,_,[Value]} <- Stream, Tag /= name]} | decode_streams(Streams)]; decode_streams([]) -> @@ -1814,6 +2066,190 @@ ssh_close(Connection=#connection{reference = CM}) -> log(Connection,disconnect), ok. +%% =========================================================================== + +%% recv/1 +%% +%% Extract incoming messages using either NETCONF 1.0 framing or +%% NETCONF 1.1 chunking. + +recv(Bin, true) -> + recv(Bin, [<<>>, 3]); +recv(Bin, false) -> + recv(Bin, <<>>); + +recv(Bin, [Head, Len | Chunks]) -> %% 1.1 chunking + chunk(<<Head/binary, Bin/binary>>, Chunks, Len); + +%% Start looking for the terminating end-of-message sequence ]]>]]> +%% 5 characters from the end of the buffered head, since this binary +%% has already been scanned. +recv(Bin, Head) when is_binary(Head) -> %% 1.0 framing + frame(<<Head/binary, Bin/binary>>, max(0, size(Head) - 5)). + +%% frame/2 +%% +%% Extract a message terminated by the ]]>]]> end-of-message sequence. +%% Don't need to extract characters as UTF-8 since matching byte-wise +%% is unambiguous: the high-order bit of every byte of a multi-byte +%% UTF character is 1, while the end-of-message sequence is ASCII. + +frame(Bin, Start) -> + Sz = size(Bin), + Scope = {Start, Sz - Start}, + case binary:match(Bin, pattern(), [{scope, Scope}]) of + {Len, 6} -> + <<Msg:Len/binary, _:6/binary, Rest/binary>> = Bin, + {trim(Msg), Rest}; + nomatch -> + Bin + end. + +%% pattern/0 + +pattern() -> + Key = ?KEY(pattern), + case get(Key) of + undefined -> + CP = binary:compile_pattern(<<"]]>]]>">>), + put(Key, CP), + CP; + CP -> + CP + end. + +%% trim/1 +%% +%% Whitespace before an XML declaration is an error, but be somewhat +%% lenient and strip line breaks since the RFC's are unclear on what's +%% allowed following a ]]>]]> delimiter. Typical seems to be a single +%% $\n, but strip any of " \t\r\n", and regardless of NETCONF version. + +trim(<<C, Bin/binary>>) + when C == $\n; + C == $\r; + C == $\t; + C == $ -> + trim(Bin); + +trim(Bin) -> + Bin. + +%% chunk/3 +%% +%% The final argument is either 0 to indicate that a specified number +%% of bytes of chunk data should be consumed, or at least 3 to +%% indicate an offset at which to look for a newline following a chunk +%% size. + +%% Accumulating chunk-data ... +chunk(Bin, [Sz | Chunks] = L, 0) -> + case Bin of + <<Chunk:Sz/binary, Rest/binary>> -> + chunk(Rest, acc(Chunk, Chunks), 3); %% complete chunk ... + _ -> + [Bin, 0 | L] %% ... or not + end; + +%% ... or a header. + +chunk(Bin, Chunks, Len) + when size(Bin) < 4 -> + [Bin, 3 = Len | Chunks]; + +%% End of chunks. +chunk(<<"\n##\n", Rest/binary>>, Chunks, _) -> + case Chunks of + [] -> + {error, "end-of-chunks unexpected"}; %% must be at least one + Bins -> + {lists:reverse(Bins), Rest} + end; + +%% Matching each of the 10 newline possibilities is faster than +%% searching. +chunk(<<"\n#", Head:1/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:2/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:3/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:4/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:5/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:6/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:7/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:8/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:9/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); +chunk(<<"\n#", Head:10/binary, $\n, Rest/binary>>, Chunks, _) -> + acc(Head, Rest, Chunks); + +chunk(<<"\n#", Bin:11/binary, _/binary>>, _, _) -> + {error, {"chunk-size too long", Bin}}; %% 32-bits = max 10 digits + +chunk(<<"\n#", _/binary>> = Bin, Chunks, _) -> + [Bin, size(Bin) | Chunks]; + +chunk(Bin, Chunks, 3 = Len) -> + case drop(Bin) of + <<>> -> + [Bin, Len | Chunks]; + <<"\n#", _/binary>> = B -> + chunk(B, Chunks, Len); + _ -> + {error, {"not a chunk", Bin}} + end. + +%% drop/1 + +drop(<<"\n#", _/binary>> = Bin) -> + Bin; + +drop(<<C, Bin/binary>>) + when C == $\n; + C == $\r; + C == $\t; + C == $ -> + drop(Bin); + +drop(Bin) -> + Bin. + +%% acc/2 + +acc(Chunk, []) -> + [B || B <- [trim(Chunk)], <<>> /= B]; + +acc(Chunk, Chunks) -> + [Chunk | Chunks]. + +%% acc/3 + +acc(Head, Rest, Chunks) -> + case chunk_size(Head) of + {error, _Reason} = No -> + No; + Sz -> + chunk(Rest, [Sz | Chunks], 0) + end. + +%% chunk_size/1 + +chunk_size(<<C, _/binary>> = Bin) -> + try true = $0 < C, binary_to_integer(Bin) of + Sz when 0 < Sz bsr 32 -> + {error, {"chunk-size too large", Sz}}; + Sz -> + Sz + catch + error: _ -> + {error, {"chunk-size invalid", Bin}} + end. %%---------------------------------------------------------------------- %% END OF MODULE diff --git a/lib/common_test/vsn.mk b/lib/common_test/vsn.mk index 8dcb69c1c6..ddc518f474 100644 --- a/lib/common_test/vsn.mk +++ b/lib/common_test/vsn.mk @@ -1 +1 @@ -COMMON_TEST_VSN = 1.17.3 +COMMON_TEST_VSN = 1.18 diff --git a/lib/compiler/doc/src/notes.xml b/lib/compiler/doc/src/notes.xml index f11444137d..4db09e8059 100644 --- a/lib/compiler/doc/src/notes.xml +++ b/lib/compiler/doc/src/notes.xml @@ -32,6 +32,84 @@ <p>This document describes the changes made to the Compiler application.</p> +<section><title>Compiler 7.4.5</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p>Code such as the following would crash the compiler in + OTP 22: <c>[some_atom = fun some_function/1]</c></p> + <p> + Own Id: OTP-15833</p> + </item> + <item> + <p>Compilation could get really slow (in the order of + minutes instead of seconds) when compiling huge + functions. (Thanks to Kostis Sagonas for reporting this + bug.)</p> + <p> + Own Id: OTP-15923</p> + </item> + <item> + <p>Fixed a bug in the validator that could reject valid + code.</p> + <p> + Own Id: OTP-15954 Aux Id: ERL-995 </p> + </item> + <item> + <p>In rare circumstances, when two clauses had identical + bodies and guard tests that tested a single boolean + variable, the guard test for the second clause could be + discarded, executing the second clause unconditionally if + the first clause was not executed.</p> + <p> + Own Id: OTP-15963</p> + </item> + <item> + <p>Fixed extremely slow compilation for huge functions + doing predominantly pattern matching.</p> + <p> + Own Id: OTP-15966 Aux Id: ERL-1014 </p> + </item> + <item> + <p>The compiler could generate unsafe code (that would + crash the runtime system) for map pattern matching. The + code could be unsafe if the matched key was not present + in the map at runtime. </p> + <p> + Own Id: OTP-15968 Aux Id: ERL-1017 </p> + </item> + <item> + <p>Correct code using try/after could fail to compile + when using the option '<c>no_type_opt</c>'.</p> + <p> + Own Id: OTP-15969 Aux Id: ERL-997 </p> + </item> + <item> + <p>The compiler could crash when compiling code that + called '<c>length/1</c>' on a binary extracted using the + binary syntax.</p> + <p> + Own Id: OTP-15970 Aux Id: ERL-1013 </p> + </item> + <item> + <p>Fixed a bug where the compiler could fail with an + internal consistency failure error when compiling receive + statements.</p> + <p> + Own Id: OTP-15982 Aux Id: ERL-1022 </p> + </item> + <item> + <p>Fixed a problem where the compiler would crash when + compiling binary matching in a function head.</p> + <p> + Own Id: OTP-15985 Aux Id: ERL-1026 </p> + </item> + </list> + </section> + +</section> + <section><title>Compiler 7.4.4</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/compiler/vsn.mk b/lib/compiler/vsn.mk index 7192ddca15..5434fdf90a 100644 --- a/lib/compiler/vsn.mk +++ b/lib/compiler/vsn.mk @@ -1 +1 @@ -COMPILER_VSN = 7.4.4 +COMPILER_VSN = 7.4.5 diff --git a/lib/crypto/doc/src/crypto.xml b/lib/crypto/doc/src/crypto.xml index 3973cf3f9f..5c1f6af016 100644 --- a/lib/crypto/doc/src/crypto.xml +++ b/lib/crypto/doc/src/crypto.xml @@ -796,7 +796,7 @@ </func> <func> - <name name="mac" arity="3" since="OTP @OTP-13872@"/> + <name name="mac" arity="3" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Short for <seealso marker="#mac-4">mac(Type, undefined, Key, Data)</seealso>. @@ -805,7 +805,7 @@ </func> <func> - <name name="mac" arity="4" since="OTP @OTP-13872@"/> + <name name="mac" arity="4" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Computes a MAC (Message Authentication Code) of type <c>Type</c> from <c>Data</c>. @@ -846,7 +846,7 @@ </func> <func> - <name name="macN" arity="4" since="OTP @OTP-13872@"/> + <name name="macN" arity="4" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Short for <seealso marker="#macN-5">macN(Type, undefined, Key, Data, MacLength)</seealso>. @@ -855,7 +855,7 @@ </func> <func> - <name name="macN" arity="5" since="OTP @OTP-13872@"/> + <name name="macN" arity="5" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Computes a MAC (Message Authentication Code) @@ -874,7 +874,7 @@ </func> <func> - <name name="mac_init" arity="2" since="OTP @OTP-13872@"/> + <name name="mac_init" arity="2" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Short for <seealso marker="#mac_init-3">mac_init(Type, undefined, Key)</seealso>. @@ -883,7 +883,7 @@ </func> <func> - <name name="mac_init" arity="3" since="OTP @OTP-13872@"/> + <name name="mac_init" arity="3" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Initializes the context for streaming MAC operations. @@ -929,7 +929,7 @@ </func> <func> - <name name="mac_update" arity="2" since="OTP @OTP-13872@"/> + <name name="mac_update" arity="2" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Updates the MAC represented by <c>State0</c> using the given <c>Data</c> which @@ -945,7 +945,7 @@ </func> <func> - <name name="mac_final" arity="1" since="OTP @OTP-13872@"/> + <name name="mac_final" arity="1" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Finalizes the MAC operation referenced by <c>State</c>. The <c>Mac</c> result will have @@ -960,7 +960,7 @@ </func> <func> - <name name="mac_finalN" arity="2" since="OTP @OTP-13872@"/> + <name name="mac_finalN" arity="2" since="OTP 22.1"/> <fsummary></fsummary> <desc> <p>Finalizes the MAC operation referenced by <c>State</c>. diff --git a/lib/crypto/doc/src/notes.xml b/lib/crypto/doc/src/notes.xml index 5f47981855..b35dddf4ff 100644 --- a/lib/crypto/doc/src/notes.xml +++ b/lib/crypto/doc/src/notes.xml @@ -31,6 +31,64 @@ </header> <p>This document describes the changes made to the Crypto application.</p> +<section><title>Crypto 4.6</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + The implementation of <c>crypto_one_time/4</c> is + adjusted to match the type specification. The spec and + the black-box behaviour of the function are unchanged.</p> + <p> + Some details: Both the spec and the implementation were + correct seen separately. But with both of them combined + simultaneously with <c>crypto_one_time/5</c> which was + called by the implementation of <c>crypto_one_time/4</c>, + an (obvious) error was detected by a Dialyzer with more + thorough checking than usual.</p> + <p> + Own Id: OTP-15884 Aux Id: ERL-974 </p> + </item> + <item> + <p> + When using crypto with FIPS mode enabled, the digests + were not correctly handled.</p> + <p> + Own Id: OTP-15911</p> + </item> + <item> + <p> + A memory leak in error handling code in + <c>ng_crypto_init_nif</c> is fixed.</p> + <p> + Own Id: OTP-15924</p> + </item> + <item> + <p> + Fixed the broken static build of the crypto nifs</p> + <p> + Own Id: OTP-15928 Aux Id: PR-2296 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + The Message Authentication Codes (MAC) CMAC, HMAC and + Poly1305 are unified into common functions in the New + Crypto API. See the manual for CRYPTO.</p> + <p> + Own Id: OTP-13872</p> + </item> + </list> + </section> + +</section> + <section><title>Crypto 4.5.1</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/crypto/vsn.mk b/lib/crypto/vsn.mk index 2315cb3c48..9a5b9397f7 100644 --- a/lib/crypto/vsn.mk +++ b/lib/crypto/vsn.mk @@ -1 +1 @@ -CRYPTO_VSN = 4.5.1 +CRYPTO_VSN = 4.6 diff --git a/lib/dialyzer/doc/src/notes.xml b/lib/dialyzer/doc/src/notes.xml index dad9fd18c7..f6cd2ec585 100644 --- a/lib/dialyzer/doc/src/notes.xml +++ b/lib/dialyzer/doc/src/notes.xml @@ -32,6 +32,23 @@ <p>This document describes the changes made to the Dialyzer application.</p> +<section><title>Dialyzer 4.1</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> Allow native compilation when using Dialyzer from + Erlang. The options <c>native</c> (defaults to + <c>false</c>) and <c>native_cache</c> have been added. + </p> + <p> + Own Id: OTP-15880 Aux Id: PR-2283 </p> + </item> + </list> + </section> + +</section> + <section><title>Dialyzer 4.0.3</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/dialyzer/vsn.mk b/lib/dialyzer/vsn.mk index a77c74c717..03155e2d24 100644 --- a/lib/dialyzer/vsn.mk +++ b/lib/dialyzer/vsn.mk @@ -1 +1 @@ -DIALYZER_VSN = 4.0.3 +DIALYZER_VSN = 4.1 diff --git a/lib/erl_docgen/doc/src/notes.xml b/lib/erl_docgen/doc/src/notes.xml index f25361a202..f51cd26a7f 100644 --- a/lib/erl_docgen/doc/src/notes.xml +++ b/lib/erl_docgen/doc/src/notes.xml @@ -31,7 +31,22 @@ </header> <p>This document describes the changes made to the <em>erl_docgen</em> application.</p> - <section><title>Erl_Docgen 0.9.1</title> + <section><title>Erl_Docgen 0.10</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> Update the documentation build support to handle FOP + 2.1 . </p> + <p> + Own Id: OTP-16051</p> + </item> + </list> + </section> + +</section> + +<section><title>Erl_Docgen 0.9.1</title> <section><title>Fixed Bugs and Malfunctions</title> <list> diff --git a/lib/erl_docgen/vsn.mk b/lib/erl_docgen/vsn.mk index fece2456c1..2ac4acaf09 100644 --- a/lib/erl_docgen/vsn.mk +++ b/lib/erl_docgen/vsn.mk @@ -1 +1 @@ -ERL_DOCGEN_VSN = 0.9.1 +ERL_DOCGEN_VSN = 0.10 diff --git a/lib/erl_interface/doc/src/notes.xml b/lib/erl_interface/doc/src/notes.xml index c47f0d2bd1..08f5a40687 100644 --- a/lib/erl_interface/doc/src/notes.xml +++ b/lib/erl_interface/doc/src/notes.xml @@ -31,6 +31,41 @@ </header> <p>This document describes the changes made to the Erl_interface application.</p> +<section><title>Erl_Interface 3.13</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix bugs in <c>ei_print_term</c> for binaries and bit + strings causing incorrect output.</p> + <p> + Own Id: OTP-15917</p> + </item> + <item> + <p> + Fixed bug in <c>ei_decode_fun</c> for very old fun + encoding format. Bug exist since OTP 22.0.</p> + <p> + Own Id: OTP-15996</p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p><c>ei_print_term()</c> now supports printing of maps + and funs.</p> + <p> + Own Id: OTP-15814</p> + </item> + </list> + </section> + +</section> + <section><title>Erl_Interface 3.12</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/erl_interface/vsn.mk b/lib/erl_interface/vsn.mk index cc72ed639a..2bf84bf18f 100644 --- a/lib/erl_interface/vsn.mk +++ b/lib/erl_interface/vsn.mk @@ -1,2 +1,2 @@ -EI_VSN = 3.12 +EI_VSN = 3.13 ERL_INTERFACE_VSN = $(EI_VSN) diff --git a/lib/eunit/doc/src/notes.xml b/lib/eunit/doc/src/notes.xml index 67a9ae5fcb..397a4657d3 100644 --- a/lib/eunit/doc/src/notes.xml +++ b/lib/eunit/doc/src/notes.xml @@ -33,6 +33,21 @@ </header> <p>This document describes the changes made to the EUnit application.</p> +<section><title>Eunit 2.3.8</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> Handle <c>get_until</c> request with explicit + encoding in the implementation of the I/O protocol. </p> + <p> + Own Id: OTP-16000</p> + </item> + </list> + </section> + +</section> + <section><title>Eunit 2.3.7</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/eunit/vsn.mk b/lib/eunit/vsn.mk index 46ef5eea3c..52d23698fa 100644 --- a/lib/eunit/vsn.mk +++ b/lib/eunit/vsn.mk @@ -1 +1 @@ -EUNIT_VSN = 2.3.7 +EUNIT_VSN = 2.3.8 diff --git a/lib/ftp/doc/src/notes.xml b/lib/ftp/doc/src/notes.xml index 61da079900..d71f795c09 100644 --- a/lib/ftp/doc/src/notes.xml +++ b/lib/ftp/doc/src/notes.xml @@ -33,7 +33,23 @@ <file>notes.xml</file> </header> - <section><title>Ftp 1.0.2</title> + <section><title>Ftp 1.0.3</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + A possibly infinite loop when receiving messages divided + in parts is removed.</p> + <p> + Own Id: OTP-16056</p> + </item> + </list> + </section> + +</section> + +<section><title>Ftp 1.0.2</title> <section><title>Fixed Bugs and Malfunctions</title> <list> diff --git a/lib/ftp/vsn.mk b/lib/ftp/vsn.mk index 9f14658099..397328ce27 100644 --- a/lib/ftp/vsn.mk +++ b/lib/ftp/vsn.mk @@ -19,6 +19,6 @@ # %CopyrightEnd% APPLICATION = ftp -FTP_VSN = 1.0.2 +FTP_VSN = 1.0.3 PRE_VSN = APP_VSN = "$(APPLICATION)-$(FTP_VSN)$(PRE_VSN)" diff --git a/lib/inets/doc/src/notes.xml b/lib/inets/doc/src/notes.xml index 45533c4f4b..da670bb1c9 100644 --- a/lib/inets/doc/src/notes.xml +++ b/lib/inets/doc/src/notes.xml @@ -33,7 +33,30 @@ <file>notes.xml</file> </header> - <section><title>Inets 7.0.9</title> + <section><title>Inets 7.1</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + httpd - Accept singel LF as line terminator</p> + <p> + Own Id: OTP-15893 Aux Id: PR-2206 </p> + </item> + <item> + <p> + mod_esi will now always propagate the actual HTTP status + code that it answered with, to later mod-modules, and not + in some cases hardcode 200.</p> + <p> + Own Id: OTP-16049 Aux Id: ERIERL-395 </p> + </item> + </list> + </section> + +</section> + +<section><title>Inets 7.0.9</title> <section><title>Fixed Bugs and Malfunctions</title> <list> @@ -66,6 +89,23 @@ </section> + <section><title>Inets 7.0.7.1</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + mod_esi will now always propagate the actual HTTP status + code that it anwsered with, to later mod-modules, and not + in some cases hardcode 200.</p> + <p> + Own Id: OTP-16049 Aux Id: ERIERL-395 </p> + </item> + </list> + </section> + +</section> + <section><title>Inets 7.0.7</title> <section><title>Fixed Bugs and Malfunctions</title> @@ -3346,5 +3386,3 @@ --> </chapter> - - diff --git a/lib/inets/vsn.mk b/lib/inets/vsn.mk index d948204618..afc02f2038 100644 --- a/lib/inets/vsn.mk +++ b/lib/inets/vsn.mk @@ -19,6 +19,6 @@ # %CopyrightEnd% APPLICATION = inets -INETS_VSN = 7.0.9 +INETS_VSN = 7.1 PRE_VSN = APP_VSN = "$(APPLICATION)-$(INETS_VSN)$(PRE_VSN)" diff --git a/lib/jinterface/doc/src/notes.xml b/lib/jinterface/doc/src/notes.xml index e79ada47f1..433534207a 100644 --- a/lib/jinterface/doc/src/notes.xml +++ b/lib/jinterface/doc/src/notes.xml @@ -31,6 +31,22 @@ </header> <p>This document describes the changes made to the Jinterface application.</p> +<section><title>Jinterface 1.10.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Replaced deprecated <tt> with <code> in + documentation.</p> + <p> + Own Id: OTP-16050</p> + </item> + </list> + </section> + +</section> + <section><title>Jinterface 1.10</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/jinterface/vsn.mk b/lib/jinterface/vsn.mk index 95c7c95726..f15a3f323b 100644 --- a/lib/jinterface/vsn.mk +++ b/lib/jinterface/vsn.mk @@ -1 +1 @@ -JINTERFACE_VSN = 1.10 +JINTERFACE_VSN = 1.10.1 diff --git a/lib/kernel/doc/src/gen_udp.xml b/lib/kernel/doc/src/gen_udp.xml index 6c0d072fed..14819aa938 100644 --- a/lib/kernel/doc/src/gen_udp.xml +++ b/lib/kernel/doc/src/gen_udp.xml @@ -213,7 +213,7 @@ </func> <func> - <name name="send" arity="3" since="OTP @OTP-15747@"/> + <name name="send" arity="3" since="OTP 22.1"/> <fsummary>Send a packet.</fsummary> <desc> <p> @@ -242,7 +242,7 @@ </func> <func> - <name name="send" arity="4" clause_i="2" anchor="send-4-AncData" since="OTP @OTP-15747@"/> + <name name="send" arity="4" clause_i="2" anchor="send-4-AncData" since="OTP 22.1"/> <fsummary>Send a packet.</fsummary> <desc> <p> @@ -265,7 +265,7 @@ </func> <func> - <name name="send" arity="4" clause_i="3" since="OTP @OTP-15747@"/> + <name name="send" arity="4" clause_i="3" since="OTP 22.1"/> <fsummary>Send a packet.</fsummary> <desc> <p> @@ -284,7 +284,7 @@ </func> <func> - <name name="send" arity="5" since="OTP @OTP-15747@"/> + <name name="send" arity="5" since="OTP 22.1"/> <fsummary>Send a packet.</fsummary> <desc> <p> diff --git a/lib/kernel/doc/src/inet.xml b/lib/kernel/doc/src/inet.xml index 3f03104734..e1a8ae567a 100644 --- a/lib/kernel/doc/src/inet.xml +++ b/lib/kernel/doc/src/inet.xml @@ -118,7 +118,7 @@ fe80::204:acff:fe17:bf38 <name name="port_number"/> </datatype> <datatype> - <name name="family_address" since="OTP @OTP-15747@"/> + <name name="family_address" since="OTP 22.1"/> <desc> <p> A general address format on the form <c>{Family, Destination}</c> @@ -130,7 +130,7 @@ fe80::204:acff:fe17:bf38 </desc> </datatype> <datatype> - <name name="inet_address" since="OTP @OTP-15747@"/> + <name name="inet_address" since="OTP 22.1"/> <desc> <warning> <p> @@ -142,7 +142,7 @@ fe80::204:acff:fe17:bf38 </desc> </datatype> <datatype> - <name name="inet6_address" since="OTP @OTP-15747@"/> + <name name="inet6_address" since="OTP 22.1"/> <desc> <warning> <p> diff --git a/lib/kernel/doc/src/notes.xml b/lib/kernel/doc/src/notes.xml index 4d31eeea3d..aea3787115 100644 --- a/lib/kernel/doc/src/notes.xml +++ b/lib/kernel/doc/src/notes.xml @@ -31,6 +31,101 @@ </header> <p>This document describes the changes made to the Kernel application.</p> +<section><title>Kernel 6.5</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + The type specification for <c>gen_sctp:connect/4,5</c> + has been corrected.</p> + <p> + Own Id: OTP-15344 Aux Id: ERL-947 </p> + </item> + <item> + <p> + Extra <c>-mode</c> flags given to <c>erl</c> are ignored + with a warning.</p> + <p> + Own Id: OTP-15852</p> + </item> + <item> + <p> + Fix type spec for <c>seq_trace:set_token/2</c>.</p> + <p> + Own Id: OTP-15858 Aux Id: ERL-700 </p> + </item> + <item> + <p> + <c>logger:compare_levels/2</c> would fail with a + <c>badarg</c> exception if given the values <c>all</c> or + <c>none</c> as any of the parameters. This is now + corrected.</p> + <p> + Own Id: OTP-15942 Aux Id: PR-2301 </p> + </item> + <item> + <p> + Fix bug where the log file in <c>logger_std_h</c> would + not be closed when the inode of the file changed. This + would in turn cause a file descriptor leak when tools + like logrotate are used.</p> + <p> + Own Id: OTP-15997 Aux Id: PR-2331 </p> + </item> + <item> + <p> + Fix a race condition in the debugging function + <c>net_kernel:nodes_info/0</c>.</p> + <p> + Own Id: OTP-16022</p> + </item> + <item> + <p> + Fix race condition when closing a file opened in + <c>compressed</c> or <c>delayed_write</c> mode.</p> + <p> + Own Id: OTP-16023</p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + The possibility to send ancillary data, in particular the + TOS field, has been added to <c>gen_udp:send/4,5</c>.</p> + <p> + Own Id: OTP-15747 Aux Id: ERIERL-294 </p> + </item> + <item> + <p> + If the log file was given with relative path, the + standard logger handler (<c>logger_std_h</c>) would store + the file name with relative path. If the current + directory of the node was later changed, a new file would + be created relative the new current directory, + potentially failing with an <c>enoent</c> if the new + directory did not exist. This is now corrected and + <c>logger_std_h</c> always stores the log file name as an + absolute path, calculated from the current directory at + the time of the handler startup.</p> + <p> + Own Id: OTP-15850</p> + </item> + <item> + <p> + Support local sockets with inet:i/0.</p> + <p> + Own Id: OTP-15935 Aux Id: PR-2299 </p> + </item> + </list> + </section> + +</section> + <section><title>Kernel 6.4.1</title> <section><title>Fixed Bugs and Malfunctions</title> @@ -147,6 +242,24 @@ </section> +<section><title>Kernel 6.3.1.3</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix bug where the log file in <c>logger_std_h</c> would + not be closed when the inode of the file changed. This + would in turn cause a file descriptor leak when tools + like logrotate are used.</p> + <p> + Own Id: OTP-15997 Aux Id: PR-2331 </p> + </item> + </list> + </section> + +</section> + <section><title>Kernel 6.3.1.2</title> <section><title>Improvements and New Features</title> diff --git a/lib/kernel/src/kernel.appup.src b/lib/kernel/src/kernel.appup.src index 95853a7a8f..d862b5491f 100644 --- a/lib/kernel/src/kernel.appup.src +++ b/lib/kernel/src/kernel.appup.src @@ -40,7 +40,8 @@ {<<"^6\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^6\\.3\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^6\\.4$">>,[restart_new_emulator]}, - {<<"^6\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}], + {<<"^6\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, + {<<"^6\\.4\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}], [{<<"^6\\.0$">>,[restart_new_emulator]}, {<<"^6\\.0\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^6\\.0\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, @@ -54,4 +55,5 @@ {<<"^6\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^6\\.3\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^6\\.4$">>,[restart_new_emulator]}, - {<<"^6\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}]}. + {<<"^6\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, + {<<"^6\\.4\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}]}. diff --git a/lib/kernel/vsn.mk b/lib/kernel/vsn.mk index e5188aa9b5..508e54237b 100644 --- a/lib/kernel/vsn.mk +++ b/lib/kernel/vsn.mk @@ -1 +1 @@ -KERNEL_VSN = 6.4.1 +KERNEL_VSN = 6.5 diff --git a/lib/megaco/doc/src/notes.xml b/lib/megaco/doc/src/notes.xml index 6f33ae390c..62d0aad77d 100644 --- a/lib/megaco/doc/src/notes.xml +++ b/lib/megaco/doc/src/notes.xml @@ -37,7 +37,24 @@ section is the version number of Megaco.</p> - <section><title>Megaco 3.18.5</title> + <section><title>Megaco 3.18.6</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix various minor issues related to Dialyzer. Mostly + these are dialyzer warnings, but there was also some + minor bugs detected by Dialyzer.</p> + <p> + Own Id: OTP-15882</p> + </item> + </list> + </section> + +</section> + +<section><title>Megaco 3.18.5</title> <section><title>Improvements and New Features</title> <list> diff --git a/lib/megaco/vsn.mk b/lib/megaco/vsn.mk index 843a3dccc5..381def97d7 100644 --- a/lib/megaco/vsn.mk +++ b/lib/megaco/vsn.mk @@ -19,6 +19,6 @@ # %CopyrightEnd% APPLICATION = megaco -MEGACO_VSN = 3.18.5 +MEGACO_VSN = 3.18.6 PRE_VSN = APP_VSN = "$(APPLICATION)-$(MEGACO_VSN)$(PRE_VSN)" diff --git a/lib/mnesia/doc/src/notes.xml b/lib/mnesia/doc/src/notes.xml index 2d38e4d01c..e918338c8a 100644 --- a/lib/mnesia/doc/src/notes.xml +++ b/lib/mnesia/doc/src/notes.xml @@ -39,7 +39,36 @@ thus constitutes one section in this document. The title of each section is the version number of Mnesia.</p> - <section><title>Mnesia 4.16</title> + <section><title>Mnesia 4.16.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + <c>mnesia:add_table_copy/3</c> could cause a deadlock if + called when a new node was starting.</p> + <p> + Own Id: OTP-15933 Aux Id: ERL-872 </p> + </item> + <item> + <p>Transactions with sticky locks could with async_asym + transactions be committed in the wrong order, since asym + transaction are spawned on the remote nodes.</p> <p>To + fix this bug the communication protocol between mnesia + nodes had to be updated, thus mnesia will no longer be + able to connect to nodes earlier than mnesia-4.14 , + OTP-19.0.</p> + <p> + *** POTENTIAL INCOMPATIBILITY ***</p> + <p> + Own Id: OTP-15979 Aux Id: ERL-768 </p> + </item> + </list> + </section> + +</section> + +<section><title>Mnesia 4.16</title> <section><title>Fixed Bugs and Malfunctions</title> <list> diff --git a/lib/mnesia/vsn.mk b/lib/mnesia/vsn.mk index aa5d9adb6d..f1a6333c18 100644 --- a/lib/mnesia/vsn.mk +++ b/lib/mnesia/vsn.mk @@ -1 +1 @@ -MNESIA_VSN = 4.16 +MNESIA_VSN = 4.16.1 diff --git a/lib/observer/doc/src/notes.xml b/lib/observer/doc/src/notes.xml index f05e58dc21..f66ab95893 100644 --- a/lib/observer/doc/src/notes.xml +++ b/lib/observer/doc/src/notes.xml @@ -32,6 +32,34 @@ <p>This document describes the changes made to the Observer application.</p> +<section><title>Observer 2.9.2</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix bug after a user followed link on a pid from an + expanded term window.</p> + <p> + Own Id: OTP-15980 Aux Id: PR-2201 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Improved dark mode colors on Linux.</p> + <p> + Own Id: OTP-15916 Aux Id: ERL-921 </p> + </item> + </list> + </section> + +</section> + <section><title>Observer 2.9.1</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/observer/vsn.mk b/lib/observer/vsn.mk index c16c43f942..3bb316a5e2 100644 --- a/lib/observer/vsn.mk +++ b/lib/observer/vsn.mk @@ -1 +1 @@ -OBSERVER_VSN = 2.9.1 +OBSERVER_VSN = 2.9.2 diff --git a/lib/os_mon/doc/src/notes.xml b/lib/os_mon/doc/src/notes.xml index 1f169263e9..63efa96e2f 100644 --- a/lib/os_mon/doc/src/notes.xml +++ b/lib/os_mon/doc/src/notes.xml @@ -31,6 +31,29 @@ </header> <p>This document describes the changes made to the OS_Mon application.</p> +<section><title>Os_Mon 2.5.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix <c>disk_sup</c> to ignore squashfs on Linux when + determining if a mounted filesystem is full or not.</p> + <p> + Own Id: OTP-15778</p> + </item> + <item> + <p> + Fix bug where <c>cpu_sup:util()</c> always returned 100% + on systems not using gnu libc, for example Alpine OS.</p> + <p> + Own Id: OTP-15974 Aux Id: ERL-1012 </p> + </item> + </list> + </section> + +</section> + <section><title>Os_Mon 2.5</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/os_mon/vsn.mk b/lib/os_mon/vsn.mk index 845443d329..6081e181ff 100644 --- a/lib/os_mon/vsn.mk +++ b/lib/os_mon/vsn.mk @@ -1 +1 @@ -OS_MON_VSN = 2.5 +OS_MON_VSN = 2.5.1 diff --git a/lib/public_key/doc/src/notes.xml b/lib/public_key/doc/src/notes.xml index 57d9898661..f47988d6d8 100644 --- a/lib/public_key/doc/src/notes.xml +++ b/lib/public_key/doc/src/notes.xml @@ -35,6 +35,33 @@ <file>notes.xml</file> </header> +<section><title>Public_Key 1.7</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Support Password based encryption with AES</p> + <p> + Own Id: OTP-15870 Aux Id: ERL-952 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Change dialyzer spec to avoid confusion</p> + <p> + Own Id: OTP-15843 Aux Id: ERL-915 </p> + </item> + </list> + </section> + +</section> + <section><title>Public_Key 1.6.7</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/public_key/vsn.mk b/lib/public_key/vsn.mk index a5e4ec8d5a..1982218574 100644 --- a/lib/public_key/vsn.mk +++ b/lib/public_key/vsn.mk @@ -1 +1 @@ -PUBLIC_KEY_VSN = 1.6.7 +PUBLIC_KEY_VSN = 1.7 diff --git a/lib/runtime_tools/doc/src/notes.xml b/lib/runtime_tools/doc/src/notes.xml index 1b94c3e6d9..210d63687c 100644 --- a/lib/runtime_tools/doc/src/notes.xml +++ b/lib/runtime_tools/doc/src/notes.xml @@ -32,6 +32,22 @@ <p>This document describes the changes made to the Runtime_Tools application.</p> +<section><title>Runtime_Tools 1.14</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Fix <c>dbg:stop_clear/0</c> to also clear trace events + (<c>send</c> and <c>'receive'</c>).</p> + <p> + Own Id: OTP-16044</p> + </item> + </list> + </section> + +</section> + <section><title>Runtime_Tools 1.13.3</title> <section><title>Improvements and New Features</title> diff --git a/lib/runtime_tools/vsn.mk b/lib/runtime_tools/vsn.mk index 3f38574be4..c01dd60009 100644 --- a/lib/runtime_tools/vsn.mk +++ b/lib/runtime_tools/vsn.mk @@ -1 +1 @@ -RUNTIME_TOOLS_VSN = 1.13.3 +RUNTIME_TOOLS_VSN = 1.14 diff --git a/lib/sasl/doc/src/notes.xml b/lib/sasl/doc/src/notes.xml index a1ae404776..245542242b 100644 --- a/lib/sasl/doc/src/notes.xml +++ b/lib/sasl/doc/src/notes.xml @@ -31,6 +31,22 @@ </header> <p>This document describes the changes made to the SASL application.</p> +<section><title>SASL 3.4.1</title> + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + The net module has been split into 'net' (kernel) and + prim_net (preloaded).</p> + <p> + Own Id: OTP-15765</p> + </item> + </list> + </section> + +</section> + <section><title>SASL 3.4</title> <section><title>Improvements and New Features</title> diff --git a/lib/sasl/src/sasl.appup.src b/lib/sasl/src/sasl.appup.src index 22a9027b7c..aabe1a904b 100644 --- a/lib/sasl/src/sasl.appup.src +++ b/lib/sasl/src/sasl.appup.src @@ -31,9 +31,13 @@ {<<"^3\\.2\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^3\\.2\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^3\\.3$">>,[restart_new_emulator]}, - {<<"^3\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}], + {<<"^3\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, + {<<"^3\\.4$">>,[restart_new_emulator]}, + {<<"^3\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}], [{<<"^3\\.2$">>,[restart_new_emulator]}, {<<"^3\\.2\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^3\\.2\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^3\\.3$">>,[restart_new_emulator]}, - {<<"^3\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}]}. + {<<"^3\\.3\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, + {<<"^3\\.4$">>,[restart_new_emulator]}, + {<<"^3\\.4\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}]}. diff --git a/lib/sasl/vsn.mk b/lib/sasl/vsn.mk index 8838b514da..b13d03dc76 100644 --- a/lib/sasl/vsn.mk +++ b/lib/sasl/vsn.mk @@ -1 +1 @@ -SASL_VSN = 3.4 +SASL_VSN = 3.4.1 diff --git a/lib/snmp/doc/src/notes.xml b/lib/snmp/doc/src/notes.xml index 780e0cae76..dd499d1069 100644 --- a/lib/snmp/doc/src/notes.xml +++ b/lib/snmp/doc/src/notes.xml @@ -34,7 +34,62 @@ </header> - <section><title>SNMP 5.3</title> + <section><title>SNMP 5.4</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix various minor issues related to Dialyzer. Mostly + these are dialyzer warnings, but there was also some + minor bugs detected by Dialyzer.</p> + <p> + Own Id: OTP-15932</p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Fixed a dets usage problem detected by dialyzer.</p> + <p> + Own Id: OTP-10400 Aux Id: kunagi-253 [164] </p> + </item> + <item> + <p> + The function snmp:print_version_info() prints various + version info. For each module a number of items are + printed, such as app vsn and md5 digest. And an attempt + was also made to print "compile time". This used to be + available in the module_info for each module, but has now + been removed.</p> + <p> + Own Id: OTP-15330</p> + </item> + <item> + <p> + The use of the deprecated random module has been replaced + the with rand module.</p> + <p> + Own Id: OTP-15331</p> + </item> + <item> + <p> + Removed use of the deprecated function + erlang:get_stacktrace(). Instead make use of the 'catch + Class:Error:Stacktrace' feature.</p> + <p> + Own Id: OTP-15332</p> + </item> + </list> + </section> + +</section> + +<section><title>SNMP 5.3</title> <section><title>Improvements and New Features</title> <list> diff --git a/lib/snmp/vsn.mk b/lib/snmp/vsn.mk index f305497cd3..2450b771f7 100644 --- a/lib/snmp/vsn.mk +++ b/lib/snmp/vsn.mk @@ -19,6 +19,6 @@ # %CopyrightEnd% APPLICATION = snmp -SNMP_VSN = 5.3 +SNMP_VSN = 5.4 PRE_VSN = APP_VSN = "$(APPLICATION)-$(SNMP_VSN)$(PRE_VSN)" diff --git a/lib/ssh/doc/src/notes.xml b/lib/ssh/doc/src/notes.xml index 60f20c7c3f..b9cb80806e 100644 --- a/lib/ssh/doc/src/notes.xml +++ b/lib/ssh/doc/src/notes.xml @@ -30,6 +30,86 @@ <file>notes.xml</file> </header> +<section><title>Ssh 4.8</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fixed wrong type definition for the daemon option + <c>subsystems</c>.</p> + <p> + Own Id: OTP-15820</p> + </item> + <item> + <p> + Fixed a possible SSH logging crash if there was a problem + in an early stage of session setup.</p> + <p> + Own Id: OTP-15962 Aux Id: ERL-990 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + The documentation for the modules ssh_connection, + ssh_sftp and ssh_sftpd are now generated from the + -spec:s.</p> + <p> + Own Id: OTP-15395</p> + </item> + <item> + <p> + Internal cleanup including removal of the internal file + <c>ssh_userauth.hrl</c>.</p> + <p> + Own Id: OTP-15876 Aux Id: PR-2255, PR-2256 </p> + </item> + <item> + <p> + Removed unused definitions in <c>ssh.hrl</c>.</p> + <p> + Own Id: OTP-15929 Aux Id: PR-2297 </p> + </item> + <item> + <p> + Removed unused fields in the internal + <c>#connection{}</c> record.</p> + <p> + Own Id: OTP-15984</p> + </item> + <item> + <p> + To get information of a <c>connection_ref()</c> from for + example <c>ssh:connect/3</c>, there was previously one + function available namely <c>ssh:connection_info/2</c>. + This ticket adds <c>ssh:connection_info/1</c> which + returns all information.</p> + <p> + For daemons (servers) started with for example + <c>ssh:daemon/2</c> the function <c>ssh:daemon_info/1</c> + returning all information was available. This ticket adds + <c>ssh:daemon_info/2</c> which returns only the + information specified in the second argument.</p> + <p> + The info of connections and of daemons now also includes + the item '<c>options</c>'. Only those options that does + not have their default values are returned.</p> + <p> + For a connection also the items '<c>algorithms</c>' and + '<c>channels</c>' are added.</p> + <p> + Own Id: OTP-16040</p> + </item> + </list> + </section> + +</section> + <section><title>Ssh 4.7.7</title> <section><title>Improvements and New Features</title> @@ -45,6 +125,22 @@ </section> +<section><title>Ssh 4.7.6.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fixed a possible SSH logging crash if there was a problem + in an early stage of session setup.</p> + <p> + Own Id: OTP-15962 Aux Id: ERL-990 </p> + </item> + </list> + </section> + +</section> + <section><title>Ssh 4.7.6</title> <section><title>Improvements and New Features</title> diff --git a/lib/ssh/vsn.mk b/lib/ssh/vsn.mk index bb87dd388c..fcf97177d8 100644 --- a/lib/ssh/vsn.mk +++ b/lib/ssh/vsn.mk @@ -1,4 +1,4 @@ #-*-makefile-*- ; force emacs to enter makefile-mode -SSH_VSN = 4.7.7 +SSH_VSN = 4.8 APP_VSN = "ssh-$(SSH_VSN)" diff --git a/lib/ssl/doc/src/notes.xml b/lib/ssl/doc/src/notes.xml index 335896c60a..2f675560d6 100644 --- a/lib/ssl/doc/src/notes.xml +++ b/lib/ssl/doc/src/notes.xml @@ -27,6 +27,75 @@ </header> <p>This document describes the changes made to the SSL application.</p> +<section><title>SSL 9.4</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Handling of zero size fragments in TLS could cause an + infinite loop. This has now been corrected.</p> + <p> + Own Id: OTP-15328 Aux Id: ERIERL-379 </p> + </item> + <item> + <p> + DTLS record check needs to consider that a resent hello + message can have a different version than the negotiated.</p> + <p> + Own Id: OTP-15807 Aux Id: ERL-920 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p> + Basic support for TLS 1.3 Client for experimental use. + For more information see the Standards Compliance chapter + of the User's Guide.</p> + <p> + Own Id: OTP-15431</p> + </item> + <item> + <p> + Correct solution for retaining tcp flow control OTP-15802 + (ERL-934) as to not break ssl:recv as reported in + (ERL-938)</p> + <p> + Own Id: OTP-15823 Aux Id: ERL-934, ERL-938 </p> + </item> + <item> + <p> + Enhance dialyzer specs to reflect implementation better + and avoid dialyzer warnings for the user that wants to + use TLS with unix domain sockets.</p> + <p> + Own Id: OTP-15851 Aux Id: PR-2235 </p> + </item> + <item> + <p> + Add support for ECDSA signature algorithms in TLS 1.3.</p> + <p> + Own Id: OTP-15854</p> + </item> + <item> + <p> + Correct error handling of TLS downgrade, possible return + values form ssl:close/2 when downgrading is {ok, Port} or + {error, Reason}, it could happen that only ok was + returned instead of {error, closed} when downgrade failed + due to that the peer closed the TCP connection.</p> + <p> + Own Id: OTP-16027</p> + </item> + </list> + </section> + +</section> + <section><title>SSL 9.3.5</title> <section><title>Improvements and New Features</title> diff --git a/lib/ssl/src/ssl.erl b/lib/ssl/src/ssl.erl index c6c94ee853..0d6501b5ee 100644 --- a/lib/ssl/src/ssl.erl +++ b/lib/ssl/src/ssl.erl @@ -1609,7 +1609,9 @@ handle_options(Opts0, Role, Host) -> proplists:delete(Key, PropList) end, Opts, ?SSL_OPTIONS ++ [ssl_imp, %% TODO: remove ssl_imp - client_preferred_next_protocols]), %% next_protocol_selector + client_preferred_next_protocols, %% next_protocol_selector + log_alert, + cb_info]), {Sock, Emulated} = emulated_options(Protocol, SockOpts), ConnetionCb = connection_cb(Opts), diff --git a/lib/ssl/vsn.mk b/lib/ssl/vsn.mk index c9547cae36..c7404c0169 100644 --- a/lib/ssl/vsn.mk +++ b/lib/ssl/vsn.mk @@ -1 +1 @@ -SSL_VSN = 9.3.5 +SSL_VSN = 9.4 diff --git a/lib/stdlib/doc/src/gen_statem.xml b/lib/stdlib/doc/src/gen_statem.xml index 0e35bd3db3..dabce02b3d 100644 --- a/lib/stdlib/doc/src/gen_statem.xml +++ b/lib/stdlib/doc/src/gen_statem.xml @@ -33,28 +33,40 @@ <description> <p> <c>gen_statem</c> provides a generic state machine behaviour - and replaces its predecessor + that for new code replaces its predecessor <seealso marker="gen_fsm"><c>gen_fsm</c></seealso> - since Erlang/OTP 20.0. + since Erlang/OTP 20.0. The <c>gen_fsm</c> behaviour remains + in OTP "as is". </p> + <note> + <p> + If you are new to <c>gen_statem</c> and want an overview + of concepts and operation the section + <seealso marker="doc/design_principles:statem"> + <c>gen_statem</c> Behaviour + </seealso> + located in the User's Guide + <seealso marker="doc/design_principles:users_guide"> + OTP Design Principles + </seealso> + is recommended to read before this reference manual, + possibly after the Description section you are reading here. + </p> + </note> <p> - This reference manual describes types generated from the types - in the <c>gen_statem</c> source code, so they are correct. + This reference manual contains type descriptions generated from + types in the <c>gen_statem</c> source code, so they are correct. However, the generated descriptions also reflect the type hierarchy, - which makes them kind of hard to read. - </p> - <p> - To get an overview of the concepts and operation of <c>gen_statem</c>, - do read the + which sometimes makes it hard to get a good overview. + If so, see the section <seealso marker="doc/design_principles:statem"> <c>gen_statem</c> Behaviour </seealso> - in + in the <seealso marker="doc/design_principles:users_guide"> OTP Design Principles </seealso> - which frequently links back to this reference manual to avoid - containing detailed facts that may rot by age. + User's Guide. </p> <note> <list type="bulleted"> @@ -1260,7 +1272,7 @@ handle_event(_, _, State, Data) -> </desc> </datatype> <datatype> - <name name="timeout_cancel_action" since="OTP @OTP-15510@"/> + <name name="timeout_cancel_action" since="OTP 22.1"/> <desc> <p> This is a shorter and clearer form of @@ -1272,7 +1284,7 @@ handle_event(_, _, State, Data) -> </desc> </datatype> <datatype> - <name name="timeout_update_action" since="OTP @OTP-15510@"/> + <name name="timeout_update_action" since="OTP 22.1"/> <desc> <p> Updates a time-out with a new <c>EventContent</c>. diff --git a/lib/stdlib/doc/src/notes.xml b/lib/stdlib/doc/src/notes.xml index 66624c43be..e2badecffa 100644 --- a/lib/stdlib/doc/src/notes.xml +++ b/lib/stdlib/doc/src/notes.xml @@ -31,6 +31,148 @@ </header> <p>This document describes the changes made to the STDLIB application.</p> +<section><title>STDLIB 3.10</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + <c>re:run()</c> now yields when validating utf8 in a + large subject.</p> + <p> + Own Id: OTP-15836 Aux Id: ERL-876 </p> + </item> + <item> + <p> + Upgraded the ERTS internal PCRE library from version 8.42 + to version 8.43. See <url + href="http://pcre.org/original/changelog.txt">http://pcre.org/original/changelog.txt</url> + for information about changes made to PCRE. This library + implements major parts of the <seealso + marker="stdlib:re"><c>re</c></seealso> regular + expressions module.</p> + <p> + Own Id: OTP-15889</p> + </item> + <item> + <p> + The bug with ID ERL-717 has been fixed. The functions + <c>io:columns()</c> and <c>io:rows()</c> only worked + correctly inside interactive erlang shells before this + fix. These functions returned <c>{error,enotsup}</c> + before this fix even if stdout and stdin were connected + to a terminal when they were invoked from an escript or a + program started with e.g., <c>erl -noshell</c>.</p> + <p> + Own Id: OTP-15959 Aux Id: ERL-717 </p> + </item> + <item> + <p>Fixed handling of ".." and "@" in wildcards. ".." + would only work when preceded by a literal pattern such + as in "a/..", not when preceded by wildcard characters + such as in "*/..". The combination "@/.." was also + broken, and in addition "@" in a pattern could degrade + performance of the wildcard matching.</p> + <p> + Own Id: OTP-15987 Aux Id: ERL-1029 </p> + </item> + <item> + <p> Make sure <c>ets:fun2ms()</c> can handle <c>++/2</c> + in the head of functions when called from the shell. </p> + <p> + Own Id: OTP-15992 Aux Id: PR-2322 </p> + </item> + </list> + </section> + + + <section><title>Improvements and New Features</title> + <list> + <item> + <p>Debugging of time-outs in <c>gen_statem</c> has been + improved. Starting a time-out is now logged in + <c>sys:log</c> and <c>sys:trace</c>. Running time-outs + are visible in server crash logs, and with + <c>sys:get_status</c>. Due to this system events + <c>{start_timer, Action, State}</c> and + <c>{insert_timout, Event, State}</c> have been added, + which may surprise tools that rely on the format of these + events. </p> <p>New features: The <c>EventContent</c> of + a running time-out can be updated with <c>{TimeoutType, + update, NewEventContent}</c>. Running time-outs can be + cancelled with <c>{TimeoutType, cancel}</c> which is more + readable than using <c>Time = infinity</c>. </p> + <p> + *** POTENTIAL INCOMPATIBILITY ***</p> + <p> + Own Id: OTP-15510</p> + </item> + <item> + <p> + <c>re:run()</c> now avoids validating utf8 in the subject + more than once in the same call. This validation could + previously be performed multiple times when the + <c>global</c> option was passed.</p> + <p> + Own Id: OTP-15831 Aux Id: ERL-876 </p> + </item> + <item> + <p> + ETS <c>ordered_set</c> tables with + <c>write_concurrency</c> enabled has got a performance + issue fixed. There were no limits for the values of + internal statistics counters before this fix. This could + result in that the data structure sometimes reacted + slowly to a change in how many parallel processes were + using it.</p> + <p> + Own Id: OTP-15906</p> + </item> + <item> + <p>The <c>ordsets:union/1</c> is now faster when passed a + long list of ordsets.</p> + <p> + Own Id: OTP-15927</p> + </item> + <item> + <p> + <c>unicode:characters_to_binary()</c> could return very + small binaries as reference counted off heap binaries. + This could cause an unnecessary large memory usage and an + unnecessary load on the binary allocator. Small binaries + are now always returned as heap binaries.</p> + <p> + Own Id: OTP-16002 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> Display a more meaningful error message when a bad + I/O server is used in a script written in Erlang + (<c>escript</c>). </p> + <p> + Own Id: OTP-16006 Aux Id: ERL-992 </p> + </item> + <item> + <p> + New feature <c>ets:info(_, binary)</c> to get information + about all reference counted binaries kept by a table. + This is the same kind of debug information that + <c>process_info(_, binary)</c> returns for a process.</p> + <p> + Own Id: OTP-16035 Aux Id: ERIERL-366 </p> + </item> + <item> + <p> + Corrected ETS documentation about the behavior of + compiled match specifications when serialized through + external format.</p> + <p> + Own Id: OTP-16038 Aux Id: PR-2366 </p> + </item> + </list> + </section> + +</section> + <section><title>STDLIB 3.9.2</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/stdlib/src/stdlib.app.src b/lib/stdlib/src/stdlib.app.src index 22d2c65cf6..5b7d2218c7 100644 --- a/lib/stdlib/src/stdlib.app.src +++ b/lib/stdlib/src/stdlib.app.src @@ -108,7 +108,7 @@ dets]}, {applications, [kernel]}, {env, []}, - {runtime_dependencies, ["sasl-3.0","kernel-6.0","erts-@OTP-15831:OTP-15836:OTP-15889:OTP-16002@","crypto-3.3", + {runtime_dependencies, ["sasl-3.0","kernel-6.0","erts-10.5","crypto-3.3", "compiler-5.0"]} ]}. diff --git a/lib/stdlib/src/stdlib.appup.src b/lib/stdlib/src/stdlib.appup.src index 0c270e9dd5..0f87d1e52a 100644 --- a/lib/stdlib/src/stdlib.appup.src +++ b/lib/stdlib/src/stdlib.appup.src @@ -41,7 +41,8 @@ {<<"^3\\.8\\.2(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^3\\.9$">>,[restart_new_emulator]}, {<<"^3\\.9\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, - {<<"^3\\.9\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}], + {<<"^3\\.9\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, + {<<"^3\\.9\\.2(?:\\.[0-9]+)*$">>,[restart_new_emulator]}], [{<<"^3\\.5$">>,[restart_new_emulator]}, {<<"^3\\.5\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, {<<"^3\\.5\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, @@ -56,4 +57,5 @@ {<<"^3\\.8\\.2(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, {<<"^3\\.9$">>,[restart_new_emulator]}, {<<"^3\\.9\\.0(?:\\.[0-9]+)+$">>,[restart_new_emulator]}, - {<<"^3\\.9\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}]}. + {<<"^3\\.9\\.1(?:\\.[0-9]+)*$">>,[restart_new_emulator]}, + {<<"^3\\.9\\.2(?:\\.[0-9]+)*$">>,[restart_new_emulator]}]}. diff --git a/lib/stdlib/vsn.mk b/lib/stdlib/vsn.mk index c2f586fef5..e2ed11a3d2 100644 --- a/lib/stdlib/vsn.mk +++ b/lib/stdlib/vsn.mk @@ -1 +1 @@ -STDLIB_VSN = 3.9.2 +STDLIB_VSN = 3.10 diff --git a/lib/syntax_tools/doc/src/notes.xml b/lib/syntax_tools/doc/src/notes.xml index a2dd78f280..31b3e45016 100644 --- a/lib/syntax_tools/doc/src/notes.xml +++ b/lib/syntax_tools/doc/src/notes.xml @@ -32,6 +32,22 @@ <p>This document describes the changes made to the Syntax_Tools application.</p> +<section><title>Syntax_Tools 2.2.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> Add missing calls to <c>erl_syntax:unwrap/1</c>. The + nodes concerned represent names and values of maps and + map types. </p> + <p> + Own Id: OTP-16012 Aux Id: PR-2348 </p> + </item> + </list> + </section> + +</section> + <section><title>Syntax_Tools 2.2</title> <section><title>Fixed Bugs and Malfunctions</title> @@ -60,6 +76,22 @@ </section> +<section><title>Syntax_Tools 2.1.7.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> Add missing calls to <c>erl_syntax:unwrap/1</c>. The + nodes concerned represent names and values of maps and + map types. </p> + <p> + Own Id: OTP-16012 Aux Id: PR-2348 </p> + </item> + </list> + </section> + +</section> + <section><title>Syntax_Tools 2.1.7</title> <section><title>Fixed Bugs and Malfunctions</title> @@ -786,4 +818,3 @@ <p>Miscellaneous changes.</p> </section> </chapter> - diff --git a/lib/syntax_tools/vsn.mk b/lib/syntax_tools/vsn.mk index 0ace11772d..9e6967d45d 100644 --- a/lib/syntax_tools/vsn.mk +++ b/lib/syntax_tools/vsn.mk @@ -1 +1 @@ -SYNTAX_TOOLS_VSN = 2.2 +SYNTAX_TOOLS_VSN = 2.2.1 diff --git a/lib/tools/doc/src/notes.xml b/lib/tools/doc/src/notes.xml index 09ae5ef04a..c1e664b10f 100644 --- a/lib/tools/doc/src/notes.xml +++ b/lib/tools/doc/src/notes.xml @@ -31,6 +31,21 @@ </header> <p>This document describes the changes made to the Tools application.</p> +<section><title>Tools 3.2.1</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p><c>cover</c> would fail to start if two processes + tried to start it at the exact same time.</p> + <p> + Own Id: OTP-15813 Aux Id: ERL-943 </p> + </item> + </list> + </section> + +</section> + <section><title>Tools 3.2</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/tools/vsn.mk b/lib/tools/vsn.mk index 191a458c62..022332e840 100644 --- a/lib/tools/vsn.mk +++ b/lib/tools/vsn.mk @@ -1 +1 @@ -TOOLS_VSN = 3.2 +TOOLS_VSN = 3.2.1 diff --git a/lib/wx/doc/src/notes.xml b/lib/wx/doc/src/notes.xml index 0c3374091d..4de771d209 100644 --- a/lib/wx/doc/src/notes.xml +++ b/lib/wx/doc/src/notes.xml @@ -32,6 +32,22 @@ <p>This document describes the changes made to the wxErlang application.</p> +<section><title>Wx 1.8.9</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + Fix a driver bug that could crashes when allocating + memory.</p> + <p> + Own Id: OTP-15883 Aux Id: PR-2261 </p> + </item> + </list> + </section> + +</section> + <section><title>Wx 1.8.8</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/wx/vsn.mk b/lib/wx/vsn.mk index 91d15de3a9..ec07f7b691 100644 --- a/lib/wx/vsn.mk +++ b/lib/wx/vsn.mk @@ -1 +1 @@ -WX_VSN = 1.8.8 +WX_VSN = 1.8.9 diff --git a/lib/xmerl/doc/src/notes.xml b/lib/xmerl/doc/src/notes.xml index 9fb4a430e5..4355b7114a 100644 --- a/lib/xmerl/doc/src/notes.xml +++ b/lib/xmerl/doc/src/notes.xml @@ -32,6 +32,23 @@ <p>This document describes the changes made to the Xmerl application.</p> +<section><title>Xmerl 1.3.22</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p> + <c>xmerl_sax_parser</c> crashed during charset detection + when the xml declarations attribute values was missing + the closing quotation (' or ").</p> + <p> + Own Id: OTP-15826</p> + </item> + </list> + </section> + +</section> + <section><title>Xmerl 1.3.21</title> <section><title>Fixed Bugs and Malfunctions</title> diff --git a/lib/xmerl/vsn.mk b/lib/xmerl/vsn.mk index 08696606e6..fc73964773 100644 --- a/lib/xmerl/vsn.mk +++ b/lib/xmerl/vsn.mk @@ -1 +1 @@ -XMERL_VSN = 1.3.21 +XMERL_VSN = 1.3.22 diff --git a/make/otp_patch_solve_forward_merge_version b/make/otp_patch_solve_forward_merge_version index b4de394767..48082f72f0 100644 --- a/make/otp_patch_solve_forward_merge_version +++ b/make/otp_patch_solve_forward_merge_version @@ -1 +1 @@ -11 +12 diff --git a/otp_versions.table b/otp_versions.table index 47b95b7ee1..d55b21470d 100644 --- a/otp_versions.table +++ b/otp_versions.table @@ -1,3 +1,4 @@ +OTP-22.1 : common_test-1.18 compiler-7.4.5 crypto-4.6 dialyzer-4.1 erl_docgen-0.10 erl_interface-3.13 erts-10.5 eunit-2.3.8 ftp-1.0.3 inets-7.1 jinterface-1.10.1 kernel-6.5 megaco-3.18.6 mnesia-4.16.1 observer-2.9.2 os_mon-2.5.1 public_key-1.7 runtime_tools-1.14 sasl-3.4.1 snmp-5.4 ssh-4.8 ssl-9.4 stdlib-3.10 syntax_tools-2.2.1 tools-3.2.1 wx-1.8.9 xmerl-1.3.22 # asn1-5.0.9 debugger-4.2.7 diameter-2.2.1 edoc-0.11 eldap-1.2.8 et-1.6.4 hipe-3.19.1 odbc-2.12.4 parsetools-2.1.8 reltool-0.8 tftp-1.0.1 : OTP-22.0.7 : compiler-7.4.4 # asn1-5.0.9 common_test-1.17.3 crypto-4.5.1 debugger-4.2.7 dialyzer-4.0.3 diameter-2.2.1 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 erts-10.4.4 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.19.1 inets-7.0.9 jinterface-1.10 kernel-6.4.1 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 parsetools-2.1.8 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 ssl-9.3.5 stdlib-3.9.2 syntax_tools-2.2 tftp-1.0.1 tools-3.2 wx-1.8.8 xmerl-1.3.21 : OTP-22.0.6 : compiler-7.4.3 dialyzer-4.0.3 hipe-3.19.1 ssl-9.3.5 # asn1-5.0.9 common_test-1.17.3 crypto-4.5.1 debugger-4.2.7 diameter-2.2.1 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 erts-10.4.4 et-1.6.4 eunit-2.3.7 ftp-1.0.2 inets-7.0.9 jinterface-1.10 kernel-6.4.1 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 parsetools-2.1.8 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 stdlib-3.9.2 syntax_tools-2.2 tftp-1.0.1 tools-3.2 wx-1.8.8 xmerl-1.3.21 : OTP-22.0.5 : dialyzer-4.0.2 erts-10.4.4 inets-7.0.9 ssl-9.3.4 # asn1-5.0.9 common_test-1.17.3 compiler-7.4.2 crypto-4.5.1 debugger-4.2.7 diameter-2.2.1 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.19 jinterface-1.10 kernel-6.4.1 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 parsetools-2.1.8 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 stdlib-3.9.2 syntax_tools-2.2 tftp-1.0.1 tools-3.2 wx-1.8.8 xmerl-1.3.21 : @@ -6,6 +7,7 @@ OTP-22.0.3 : compiler-7.4.2 dialyzer-4.0.1 erts-10.4.2 ssl-9.3.2 stdlib-3.9.2 # OTP-22.0.2 : compiler-7.4.1 crypto-4.5.1 erts-10.4.1 stdlib-3.9.1 # asn1-5.0.9 common_test-1.17.3 debugger-4.2.7 dialyzer-4.0 diameter-2.2.1 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.19 inets-7.0.8 jinterface-1.10 kernel-6.4 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 parsetools-2.1.8 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 ssl-9.3.1 syntax_tools-2.2 tftp-1.0.1 tools-3.2 wx-1.8.8 xmerl-1.3.21 : OTP-22.0.1 : ssl-9.3.1 # asn1-5.0.9 common_test-1.17.3 compiler-7.4 crypto-4.5 debugger-4.2.7 dialyzer-4.0 diameter-2.2.1 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 erts-10.4 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.19 inets-7.0.8 jinterface-1.10 kernel-6.4 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 parsetools-2.1.8 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 stdlib-3.9 syntax_tools-2.2 tftp-1.0.1 tools-3.2 wx-1.8.8 xmerl-1.3.21 : OTP-22.0 : asn1-5.0.9 common_test-1.17.3 compiler-7.4 crypto-4.5 debugger-4.2.7 dialyzer-4.0 edoc-0.11 eldap-1.2.8 erl_docgen-0.9.1 erl_interface-3.12 erts-10.4 hipe-3.19 inets-7.0.8 jinterface-1.10 kernel-6.4 megaco-3.18.5 mnesia-4.16 observer-2.9.1 odbc-2.12.4 os_mon-2.5 public_key-1.6.7 reltool-0.8 runtime_tools-1.13.3 sasl-3.4 snmp-5.3 ssh-4.7.7 ssl-9.3 stdlib-3.9 syntax_tools-2.2 tools-3.2 wx-1.8.8 xmerl-1.3.21 # diameter-2.2.1 et-1.6.4 eunit-2.3.7 ftp-1.0.2 parsetools-2.1.8 tftp-1.0.1 : +OTP-21.3.8.7 : erts-10.3.5.5 inets-7.0.7.1 kernel-6.3.1.3 ssh-4.7.6.1 syntax_tools-2.1.7.1 # asn1-5.0.8 common_test-1.17.2.1 compiler-7.3.2 crypto-4.4.2 debugger-4.2.6 dialyzer-3.3.2 diameter-2.2.1 edoc-0.10 eldap-1.2.7 erl_docgen-0.9 erl_interface-3.11.3 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.18.3 jinterface-1.9.1 megaco-3.18.4 mnesia-4.15.6 observer-2.9 odbc-2.12.3 os_mon-2.4.7 otp_mibs-1.2.1 parsetools-2.1.8 public_key-1.6.6.1 reltool-0.7.8 runtime_tools-1.13.2 sasl-3.3 snmp-5.2.12 ssl-9.2.3.5 stdlib-3.8.2.2 tftp-1.0.1 tools-3.1.0.1 wx-1.8.7 xmerl-1.3.20.1 : OTP-21.3.8.6 : ssl-9.2.3.5 # asn1-5.0.8 common_test-1.17.2.1 compiler-7.3.2 crypto-4.4.2 debugger-4.2.6 dialyzer-3.3.2 diameter-2.2.1 edoc-0.10 eldap-1.2.7 erl_docgen-0.9 erl_interface-3.11.3 erts-10.3.5.4 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.18.3 inets-7.0.7 jinterface-1.9.1 kernel-6.3.1.2 megaco-3.18.4 mnesia-4.15.6 observer-2.9 odbc-2.12.3 os_mon-2.4.7 otp_mibs-1.2.1 parsetools-2.1.8 public_key-1.6.6.1 reltool-0.7.8 runtime_tools-1.13.2 sasl-3.3 snmp-5.2.12 ssh-4.7.6 stdlib-3.8.2.2 syntax_tools-2.1.7 tftp-1.0.1 tools-3.1.0.1 wx-1.8.7 xmerl-1.3.20.1 : OTP-21.3.8.5 : erts-10.3.5.4 ssl-9.2.3.4 # asn1-5.0.8 common_test-1.17.2.1 compiler-7.3.2 crypto-4.4.2 debugger-4.2.6 dialyzer-3.3.2 diameter-2.2.1 edoc-0.10 eldap-1.2.7 erl_docgen-0.9 erl_interface-3.11.3 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.18.3 inets-7.0.7 jinterface-1.9.1 kernel-6.3.1.2 megaco-3.18.4 mnesia-4.15.6 observer-2.9 odbc-2.12.3 os_mon-2.4.7 otp_mibs-1.2.1 parsetools-2.1.8 public_key-1.6.6.1 reltool-0.7.8 runtime_tools-1.13.2 sasl-3.3 snmp-5.2.12 ssh-4.7.6 stdlib-3.8.2.2 syntax_tools-2.1.7 tftp-1.0.1 tools-3.1.0.1 wx-1.8.7 xmerl-1.3.20.1 : OTP-21.3.8.4 : common_test-1.17.2.1 erts-10.3.5.3 kernel-6.3.1.2 public_key-1.6.6.1 ssl-9.2.3.3 stdlib-3.8.2.2 # asn1-5.0.8 compiler-7.3.2 crypto-4.4.2 debugger-4.2.6 dialyzer-3.3.2 diameter-2.2.1 edoc-0.10 eldap-1.2.7 erl_docgen-0.9 erl_interface-3.11.3 et-1.6.4 eunit-2.3.7 ftp-1.0.2 hipe-3.18.3 inets-7.0.7 jinterface-1.9.1 megaco-3.18.4 mnesia-4.15.6 observer-2.9 odbc-2.12.3 os_mon-2.4.7 otp_mibs-1.2.1 parsetools-2.1.8 reltool-0.7.8 runtime_tools-1.13.2 sasl-3.3 snmp-5.2.12 ssh-4.7.6 syntax_tools-2.1.7 tftp-1.0.1 tools-3.1.0.1 wx-1.8.7 xmerl-1.3.20.1 : |