Maintenance Release Changelog v8. 5
On this page
2024-12-18 Version 8. 5. 38
-
New feature: Added support for the
file_
parameter in thecompression CONFIG
clause ofCREATE PIPELINE AS .
statement.. . LOAD DATA S3 Decompresses files with the specified extensions. Refer to S3 Configurations for more information. (8. 5. 38) -
Enhancement: Added the
TABLE_
column to theNAME LOAD_
information schema view.DATA_ ERRORS TABLE_
is the name of the table associated with the error.NAME (8. 5. 38) -
Bugfix: Fixed bottomless upload throttling criteria.
-
Bugfix: Blocked creation of temporary table as a shallow copy.
-
Bugfix: Fixed display of default BSON and string values with null-terminators in the information_
schema. -
Bugfix: Fixed
IN
-list index matching for columnstore tables when a query has multipleIN
-list predicates.
2024-11-26 Version 8. 5. 37
-
Bugfix: Fixed a bug that led to a master aggregator crash when using dynamic resource pools.
(8. 5. 37) -
Bugfix: Fixed a crash that occurred during spilling when executing a query with a large number of
GROUP BY
columns.(8. 5. 37) -
Bugfix: Allowed cached table memory to be freed for empty tables in replica databases.
(8. 5. 37) -
Bugfix: Fixed a deadlock in a corner case involving index eviction and replaying two-phase commit transactions.
(8. 5. 37) -
Bugfix: Fixed the result of
ORDER BY .
queries on tables with a sort key column defined in. . LIMIT DESC
order.(8. 5. 37) -
Bugfix: Fixed an issue caused when multi-part names were used in common table expressions (CTEs) within
UNION
.(8. 5. 37)
2024-11-05 Version 8. 5. 36
-
Enhancement: Improved out of memory (OOM) error message to make the message more accurate.
-
Bugfix: Fixed a crash that could occur when columns were dropped with
ALTER TABLE
. -
Bugfix: Fixed an issue where left join sometimes returned an incorrect result when spilling occurred.
2024-10-21 Version 8. 5. 35
-
Enhancement: Improved the performance of regular expression (regex) operations.
2024-10-15 Version 8. 5. 34
-
Bugfix: Fixed an issue where the garbage collection of a partition database's 2PC transaction table could unnecessarily delay the reprovisioning of the reference database.
-
Bugfix: Fixed deadlock in database recovery due to evicting table module holding an open LOCK.
2024-10-09 Version 8. 5. 33
-
Enhancement: Added a new
max_
global variable that sets the maximum number of merger threads that the autostats updater can run on.autostats_ update_ workers -
Enhancement: Fixed the
KILLED_
counter inQUERIES MV_
.RESOURCE_ POOL_ STATUS -
Enhancement: Added a new filter derivation rewrite controlled by the
optimizer_
engine variable.not_ null_ filter_ derivation -
Enhancement: When printing the table digest SHA value, the table DDL schema is also printed to
memsql_
.METADATA. log
2024-10-02 Version 8. 5. 32
-
Enhancement: Added metrics to track the availability of unlimited storage and the bottle service.
-
Bugfix: Fixed a certificate refresh issue for connections to remote storage in long-running clusters.
-
Enhancement: Added bottle service reliability metrics to
MV_
.BOTTOMLESS_ STATUS_ EXTENDED -
Bugfix: Fixed a rare issue where a membership-related clustering operation could delay the re-provision or deletion of a cluster database.
-
Bugfix: Fixed an issue where
JSON_
queries withMATCH_ ANY() MATCH_
evaluated incorrectly on non-array values.ELEMENTS -
Bugfix: Fixed sporadic reading failures from
MV_
.SYSINFO_ CPU
2024-09-05 Version 8. 5. 31
-
Bugfix: Clarified the error message produced in some cases where a snapshot gets aborted.
-
Enhancement: Updated the distributed OpenSSL license file.
-
Enhancement: Update to certificate loading behavior.
Prior to this change, only the first certificate was loaded from a server's . pem file specified via the server configuration. Now all certificates are loaded, so if a . pem file contains a certificates chain, then intermediate CA certificates will be returned by the server.
2024-08-14 Version 8. 5. 30
-
Bugfix: Fixed an issue where concurrent
DROP TABLE
s could block a snapshot from running indefinitely. -
Enhancement: Added
X-Content-Type-Options: nosniff
,Strict-Transport-Security: max-age=31536000
,Cache-control: no-store
headers to Data API responses. -
Enhancement: Improved performance of VECTOR-type User-Defined Variables(UDVs).
No longer require using extra typecast to BLOB datatype. -
Bugfix: Fixed a rare race condition where PITR would incorrectly operate on an unrecoverable database.
2024-07-30 Version 8. 5. 29
-
Bugfix: Fixed a password validation error on
ADD AGGREGATOR
. -
Bugfix: Fixed an issue that could occur when replacing JSON expressions with computed columns in
GROUP BY
lists. -
Enhancement: Added a new engine variable,
sampling_
, used to configure sampling in columnstore tables.estimate_ approach See Statistics and Sampling Concepts for more information.
-
Enhancement: Added websocket_
proxy. log to the files managed via Trace Log Rotation. -
Enhancement: Added a new engine variable:
assume_
.udfs_ deterministic This variable controls behavior where SingleStore will do extra work to avoid issues caused by UDFs that return different values when repeatedly invoked (e. g. , are non-deterministic). This variable defaults to false, preserving the existing behavior (since SingleStore version 8. 0), where SingleStore will ensure these computations take place once on an aggregator node. When set to true, SingleStore will avoid this extra layer of coordination (and bottleneck) allowing leaf nodes to independently coordinate. -
Bugfix: Fixed an issue where in a VM environment
SHOW LEAVES
could show corrupted latency values due to incorrect values from the system clock if the VM is stopped or migrated. -
Enhancement: Added a method to throttle upload ingest when blob cache has low evictability and running out of disk space is imminent.
This is controlled via two new engine variables: bottomless_
andupload_ throttle_ hard_ limit_ cache_ usability bottomless_
.upload_ throttle_ soft_ limit_ cache_ usability bottomless_
: The usability (free space + evictable space) of blob cache below which all columnstore ingest is throttled.upload_ throttle_ hard_ limit_ cache_ usability bottomless_
: The usability (free space + evictable space) of blob cache below which some columnstore ingest is throttled.upload_ throttle_ soft_ limit_ cache_ usability
2024-07-16 Version 8. 5. 28
-
Enhancement: Added a new engine variable,
enable_
.extended_ types_ metadata Used to enable the handling of extended data types that are not defined in MySQL enum_
.field_ types Default is disabled. When enabled, SingleStore may send extended metadata to the client. It provides the ability to distinguish between different data types, and handle them appropriately in client applications. -
Bugfix: Fixed display of microseconds for default TIMESTAMP(6) column values in system information commands (such as
DESCRIBE TABLE
orINFORMATION_
).SCHEMA. COLUMNS. COLUMN_ DEFAULT -
Bugfix: Fixed a potential false positive output for OBSERVE queries during the first delete of large columnstore segments.
-
Bugfix: Fixed an issue where user defined variables could read collation-related variables incorrectly during a
SET @var = .
command.. . -
Enhancement: Allow leading 0x prefix for
OBSERVE
offsets. -
Bugfix: Fixed an issue where the output of the
OBSERVE
query for the first delete on a columnstore segment was the inverse of expected. -
Bugfix: Fixed issue where, in a stored procedure query-type-variable definition, a column was incorrectly assumed to belong to a table in an outer select when it was possible that the column instead belonged to a yet to be defined table.
-
Enhancement: SingleStore throws an error when inserting incorrect data into vector column for any
data_
.conversion_ compatibility_ level
2024-07-02 Version 8. 5. 27
-
Bugfix: Identified an upgrade scenario that causes a blob leak.
As a result, temporarily disallowing shallow table copy for tables created on version 8. 0 or before. -
Enhancement: Added support for
ON NODE
clause forSHOW PROFILE PROCESS|PLAN
, which forwards the command to another aggregator. -
Enhancement: Improved performance of the
CREATE PROJECTION
command. -
Enhancement: Added support to execute
KILL QUERY
on leaf node IDs. -
Bugfix: Unneeded sort fields will no longer be projected to the aggregator.
-
Enhancement: Enhance table pushdown to union rewrite to enable derived table pushdown based on row count estimation.
-
Bugfix: Fixed an issue where deleting a local user on a leaf made aggregates fail to run on that leaf.
2024-06-28 Version 8. 5. 26
-
Bugfix: Fixed a rare issue where Unlimited Storage GC could use up all of the MA's available connections.
-
Bugfix: Identified an upgrade scenario that causes a blob leak and added a command to delete the leaked blobs.
-
Enhancement: Updated the
MV_
information schema table:BOTTOMLESS_ STATUS_ EXTENDED -
Removed the
LATEST_
andAPI_ FAILURE_ RATE AVERAGE_
columns.API_ LATENCY_ US -
Added the following columns:
SUCCESS_
- Number of successful remote storage api calls per second over the last 30 seconds.API_ PER_ SECOND FAILED_
- Number of failed remote storage api calls per second over the last 30 seconds.API_ PER_ SECOND AVERAGE_
- Average latency to complete a remote storage api event over the past 30 seconds.API_ EVENT_ LATENCY_ US Includes time taken on retries or waiting for rate limiting. AVERAGE_
- Average latency of receiving a response for a remote storage api request.API_ RESPONSE_ LATENCY_ US Excludes waiting for rate limiting or retries. NOTE: This is relevant only for S3. otherwise this field is identical to AVERAGE_
.API_ EVENT_ LATENCY_ US
-
2024-06-20 Version 8. 5. 25
-
Bugfix: Fixed a crash that occurred when dropping a database with tables containing very high and very low column IDs.
2024-06-18 Version 8. 5. 24
-
Bugfix: Fixed issues with the
TO_
function where results were truncated or reading communication packet errors were generated.CHAR() -
Bugfix: Fixed an integer overflow issue in unique integer columns by changing the storage type to a 32-bit unsigned integer.
-
Bugfix: Fixed incorrect results in an uncommon scenario where hash join operators with an optimization path need to spill.
-
Enhancement: The
memsql_
now collects additional fields from theexporter mv_
information schema view.activities_ extended_ cumulative -
Enhancement: Updated the default
client.
for the Kafka configuration to the SingleStore partner ID.id
2024-06-12 Version 8. 5. 23
-
Enhancement: Added the following monitoring metrics to the
information_
view:schema. mv_ bottomless_ status_ extended NUM_
,SUCCESS_ API_ REQUESTS NUM_
,FAILED_ API_ REQUESTS LATEST_
,API_ FAILURE_ RATE AVERAGE_
,API_ LATENCY_ US IS_
,GC_ RUNNING NUM_
, andREMOTE_ FILES_ DELETED NUM_
.SLOW_ DOWNS -
Bugfix: Fixed a crash that occurred when spilling a hash join operation with at least 3 tables.
-
Bugfix: Fixed a crash that occurred when running the
SHOW CREATE PROJECTIONS
command when using the database name in the syntax (SHOW CREATE PROJECTIONS database_
).name. projection_ name. . . -
Bugfix: Fixed an issue with incorrect results in
information_
when filtering on theschema. PROJECTIONS PROJECTION_
column.NAME -
Enhancement: Improved performance related to
PIPELINES_
information schema table.BATCHES -
Enhancement: An engine variable
enable_
has been added to allow the query optimizer to use stale statistics instead of querying for statistics during optimization.use_ of_ stale_ incremental_ stats -
Bugfix: Fixed an issue where histograms are built from up to 10x more rows than desired.
2024-05-28 Version 8. 5. 22
-
Enhancement: Added
STORAGE_
andID COMPUTE_
toID INFORMATION_
,SCHEMA. TABLE_ STATISTICS COLUMNAR_
, andSEGMENTS MV_
.COLUMNSTORE_ FILES -
Bugfix: Fixed a crash issue with
JSON_
.TO_ ARRAY Disabled JSON_
TVF join optimization if query does not use the TVF output column.TO_ ARRAY The crash specifically occurs when
JSON_
join optimization is triggered and when there is no usage ofTO_ ARRAY table_
output of thecol TABLE(JSON_
statement in the evaluation of the query.TO_ ARRAY()) For example, prior to this fix:
The following query will crash (because the
table_
output of thecol TABLE(JSON_
statement is unused):TO_ ARRAY(t. json)) SELECT t.a FROM t JOIN TABLE(JSON_TO_ARRAY(t.json)) GROUP BY 1;The following query will NOT crash:
SELECT table_col::a::b, t.a FROM t JOIN TABLE(JSON_TO_ARRAY(t.json)) GROUP BY 1, 2; -
Enhancement: Added more information to filesystem error messages.
2024-05-21 Version 8. 5. 21
-
Bugfix: Fixed an issue in
ALTER TABLE
when adding a computed column containingJSON_
.BUILD_ OBJECT -
Bugfix: Addressed a crash issue with
REGEX_
.REPLACE
2024-05-16 Version 8. 5. 20
-
Bugfix: Reduced stack usage during compilation for some
CASE
expressions with manyWHEN-THEN
statements. -
Bugfix: Fixed a potential deadlock issue between background garbage collector threads and foreground query execution threads.
-
Bugfix: Fixed a collation issue in the
JSON_
information schema table.COLUMN_ SCHEMA -
Enhancement: SingleStore now supports module eviction of idle tables with an
ALTER
history.This means that, prior to the 8. 5. 20 release, tables that had been altered could not be evicted. Altered here includes CREATE INDEX
,ALTER TABLE ADD COLUMN
, and some others.
2024-05-07 Version 8. 5. 19
-
Bugfix: Fixed a bug with Wasm UDFs where
REPLACE FUNCTION
did not correctly evict from the plancache, causing continued usage of the old UDF after replacement.
2024-04-30 Version 8. 5. 18
-
Bugfix: Fixed an upgrade issue present in version 8.
5. 17. -
Bugfix: Fixed a BSON issue that could occur when large documents are read and mistakenly reported as corrupted.
-
Enhancement: Upgraded OpenSSL 1.
0. 2u to 1. 0. 2zj -
Bugfix: Fixed a crash issue that could occur under a rare race condition in some distributed join queries.
-
Bugfix: Fixed statement atomicity in transactions writing to tables that have projections on them.
-
Enhancement: Allow Kerberos users to skip password validation for users who are authenticated with plugins.
2024-04-23 Version 8. 5. 17
Warning
Version 8.
-
Enhancement: Added support for loading data from compressed Avro datafiles.
-
Bugfix: Fixed an issue that occurred when primary key is NULLABLE when copying a table using "Create table as select" statement.
-
Enhancement: Added a new engine variable,
enable_
.extended_ types_ metadata Used to enable the handling of extended data types that are not defined in MySQL enum_
.field_ types Default is disabled. When enabled, SingleStore may send extended metadata to the client. It provides the ability to distinguish between different data types, and handle them appropriately in client applications. -
Bugfix: Addressed a crash issue occurring while executing queries with vector builtins on clusters running via Docker containers on Mac machines equipped with Apple silicon processors (M1).
-
Bugfix: No longer show information_
schema pipeline metadata of databases that are not attached to the workspace. -
Enhancement: Use SeekableString encoding by default for storing VECTOR datatype columns in columnstore tables.
-
Bugfix: Fixed an issue that caused rare "Arrangement already exists in namespace" errors in recursive CTE queries.
-
Bugfix: Improved the hashGroupBy spilling condition to trigger (spill) when appropriate.
2024-04-18 Version 8. 5. 16
-
Enhancement: Added a new engine variable
costing_
which sets the maximum amount of tables we allow in full DQO estimate search when filling table row estimates for distributed join hints.max_ djo_ tables
2024-04-08 Version 8. 5. 15
-
Enhancement: Made many more engine variables configurable on SingleStore Helios:
multi_
insert_ tuple_ count, columnstore_ row_ value_ table_ lock_ threshold, internal_ columnstore_ max_ uncompressed_ blob_ size, internal_ columnstore_ max_ uncompressed_ rowindex_ blob_ size, columnstore_ validate_ blob_ before_ merge, default_ max_ histogram_ buckets, enable_ varbuffer_ dictionary_ compression, enable_ alias_ space_ trim, skip_ segelim_ with_ inlist_ threshold, default_ autostats_ histogram_ mode, default_ autostats_ columnstore_ cardinality_ mode, default_ autostats_ rowstore_ cardinality_ mode, default_ autostats_ columnstore_ sampling, experimental_ disable_ multipartition_ parallel_ read, internal_ enable_ parallel_ query_ throttling, enable_ spilling, spilling_ node_ memory_ threshold_ ratio, spilling_ query_ operator_ memory_ threshold, regexp_ compile_ mem_ mb, selectivity_ estimation_ min_ sample_ size, repartition_ minimum_ buffer_ size, use_ seekable_ json, json_ document_ max_ children, json_ document_ max_ leaves, json_ document_ sparse_ children_ check_ threshold, json_ document_ sparse_ children_ check_ ratio, json_ document_ absolute_ sparse_ key_ check_ ratio, json_ document_ page_ data_ soft_ limit, ignore_ insert_ into_ computed_ column, max_ subselect_ aggregator_ rowcount, leaf_ pushdown_ enable_ rowcount, reshuffle_ group_ by_ base_ cost, max_ broadcast_ tree_ rowcount, enable_ broadcast_ left_ join, display_ full_ estimation_ stats, force_ bushy_ joins, force_ heuristic_ rewrites, force_ table_ pushdown, force_ bloom_ filters, explain_ joinplan_ costs, statistics_ warnings, optimizer_ warnings, optimize_ constants, optimize_ huge_ expressions, optimize_ expressions_ larger_ than, optimize_ stmt_ threshold, quadratic_ rewrite_ size_ limit, batch_ external_ functions, batch_ external_ functions_ size, optimizer_ enable_ json_ text_ matching, optimizer_ enable_ orderby_ limit_ self_ join, distributed_ optimizer_ broadcast_ mult, distributed_ optimizer_ old_ selectivity_ table_ threshold, distributed_ optimizer_ selectivity_ fallback_ threshold, distributed_ optimizer_ verbose, old_ local_ join_ optimizer, optimizer_ hash_ join_ cost, optimizer_ merge_ join_ cost, optimizer_ nested_ join_ cost, optimizer_ disable_ right_ join, interpreter_ mode_ sampling_ threshold, hash_ groupby_ segment_ distinct_ values_ threshold, sampling_ estimates_ for_ complex_ filters, enable_ histogram_ to_ unwrap_ literals, estimate_ zero_ rows_ when_ sampling_ data_ is_ missing, exclude_ scalar_ subselects_ from_ filters, leaf_ pushdown_ default, distributed_ optimizer_ nodes, optimizer_ num_ partitions, enable_ binary_ protocol, enable_ multipartition_ queries, enable_ local_ shuffle_ group_ by, enable_ skiplist_ sampling_ for_ selectivity, columnstore_ sample_ per_ partition_ limit, disable_ sampling_ estimation, disable_ histogram_ estimation, inlist_ precision_ limit, allow_ materialize_ cte_ with_ union, optimizer_ cross_ join_ cost, distributed_ optimizer_ run_ legacy_ heuristic, distributed_ optimizer_ min_ join_ size_ run_ initial_ heuristics, distributed_ optimizer_ unrestricted_ search_ threshold, singlebox_ optimizer_ cost_ based_ threshold, distributed_ optimizer_ estimated_ restricted_ search_ cost_ bound, disable_ reference_ table_ leftjoin_ where_ pushdown, disable_ sampling_ estimation_ with_ histograms, disable_ subquery_ merge_ with_ straight_ joins, default_ columnstore_ table_ lock_ threshold, default_ spill_ dependent_ outputters, query_ rewrite_ loop_ iterations, verify_ fields_ in_ transitivity, optimizer_ min_ reference_ tables_ for_ gathered_ join, optimizer_ min_ reference_ rows_ for_ gathered_ join, max_ expression_ query_ limit, max_ expression_ item_ limit, optimizer_ empty_ tables_ limit, optimizer_ beam_ width, optimizer_ disable_ subselect_ to_ join, disable_ remove_ redundant_ gby_ rewrite, subquery_ merge_ with_ outer_ joins, optimizer_ disable_ operator_ tree_ nullability_ check, clamp_ histogram_ date_ estimates, varchar_ column_ string_ optimization_ length, histogram_ column_ correlation, use_ column_ correlation, consider_ secondary_ projection, optimizer_ disable_ semi_ join_ reduction, optimizer_ gb_ placement_ table_ limit, optimizer_ disable_ transitive_ predicates -
Enhancement: Added more config information about pipelines to
memsql_
.exporter -
Enhancement: Improved error handling for VECTOR type.
-
Enhancement: Added support for aggregate functions (
FIRST
,LAST
) with VECTOR datatype. -
Enhancement: Added support for Kafka key (producer) in the SELECT .
. . INTO KAFKA command. -
Enhancement: Improved Kafka error messages to make them more specific.
-
Bugfix: Fixed a case where a killed query could incorrectly return a JSON error rather than query interrupted message.
-
Bugfix:
MV_
queries can no longer block garbage collection.DISK_ USAGE -
Bugfix: Fixed a crash-on-startup issue on RHEL-based operating systems/kernels (CentOS 9, RHEL, etc.
). -
Bugfix: Fixed potential deadlock between table module eviction and GC manager.
-
Bugfix: Fixed a crash that could occur when a scalar subselect is passed as an argument to an external TVF.
-
Bugfix: Fixed an issue with restoring from public backups.
-
Bugfix: Backups now throttle after snapshot.
2024-04-02 Version 8. 5. 14
-
New Feature: Added ability to create a Projection which is a copy of some or all columns in a table, and may be sharded and sorted differently than the primary table.
Projections can be used to speed up several types of queries including range filters, ORDER BY
/LIMIT
,GROUP BY
,count(DISTINCT.
,. . ) DISTINCT
, joins, and row lookups on secondary keys.Projections depend on the table and are updated in real time when you update the table. Related information schema table: PROJECTIONS. -
Bugfix: Removed an unnecessary metadata copy to improve JSON performance.
-
Enhancement: Multi-insert queries now respect lower
columnstore_
settings.segment_ rows -
Enhancement: Subprocess and S3 API tracing are now also enabled via the
enable_
engine variable.subprocess_ tracing -
Enhancement: Added the optional
IF NOT EXISTS
clause to theCREATE TABLE .
statement.. . AS INFER PIPELINE Refer to Replicate Data from MongoDB® for more information.
2024-03-27 Version 8. 5. 13
-
Enhancement: Dedicated Admin Connections via a TCP port.
Added two new engine variables, enable_
anddac_ ip_ port dac_
- these can be used to open an extra mysql port on startup which will accept dedicated admin connections.ip_ port -
Enhancement: The Tracelog rotation threshold now applies to rotated logs.
Added two new engine variables to control the total size of retained log files: auditlog_
andretention_ size tracelog_
.retention_ size -
Bugfix:
LAST_
will now correctly retrieve the last inserted ID for a forwardedINSERT_ ID INSERT
query. -
Bugfix: The rule based optimization warning message will only be shown when cost based optimization is meaningful.
-
Bugfix: Fixed a minor performance issue where a table module could be evicted prematurely during database recovery.
-
Bugfix: Fixed a very rare deadlock between
ALTER
of a table and aDROP
of a database. -
Bugfix: Fixed a JSON insertion failure to old utf8 sample tables that contain utf8mb4 characters by encoding it with base64 format beforehand for backward compatibility.
-
Enhancement: Disk Spilling now takes
QUERY_
resource pool setting into consideration.MEMORY_ PERCENTAGE
2024-03-19 Version 8. 5. 12
-
Bugfix: Fixed an issue with a blob file leak in a rare crash scenario.
-
Bugfix: Fixed a potential deadlock in a scenario involving DDL, a 2PC transaction, and a concurrent failover.
-
Bugfix: Fixed a deadlock involving
BACKUP
andALTER
in a rare case. -
Enhancement: Added support for utf8mb4 symbols in column comments, table comments, and user comments.
-
Enhancement: Enabled additional query hint for non-distributed queries so that first run of those queries can be queued.
-
Enhancement: Updated timezone data, now using IANA's tzdata version 2024a; new timezones Kyiv, Ciudad_
Juarez, and Kanton supported.
2024-03-13 Version 8. 5. 11
-
Bugfix: Fixed an issue in background merger that allowed concurrent deletes of empty segments.
-
Bugfix: Fixed an issue to ensure preserving a field of a table correctly.
-
Enhancement: Idle Table Eviction improvement.
In the 8. 5 GA version, an idle table's objects cannot be evicted from memory if the table has one or more UNIQUE key columns (both PRIMARY KEYs and any other keys with a UNIQUE constraint). In the 8. 5. 11 patch, idle tables' code objects can be evicted from memory if the table has one or more UNIQUE key columns.
2024-03-06 Version 8. 5. 10
-
Enhancement: Added
numInferredPaths
andschemaSize
as new columns toJSON_
table.COLUMN_ SCHEMA numInferredPaths
is the number of key paths inferred for the segment.schemaSize
is the size ofschema_
in bytes.json -
Bugfix: Added safety checks around dropping databases without exclusive access to storage.
-
Enhancement: Added logging to heartbeat thread in order to better diagnose process stalls.
This logging is enabled/disabled via the new verbose_
engine variable.time_ heartbeat_ thread The default value is off
, setting this toon
will enable the logging. -
Enhancement: Added the ability to collect and send SingleStore Self-Managed usage telemetry data to SingleStore via the
EXPORT TELEMETRY
sql command (for 1-time or ad hoc use) or thesend_
engine variable.usage_ telemetry This defaults to OFF. Added an associated information schema table: usage_
.telemetry_ status -
Bugfix: Fixed an issue where explicitly defining a JSON type in the RETURNS of a Wasm TVF can cause an error when it is run.
-
Bugfix: Fixed a rare crash scenario.
-
Bugfix: Fixed an issue that could lead to the risk of undefined behavior when running
DROP EXTENSION IF EXISTS
. -
Enhancement:
IN
-lists will now use hashmap optimization for matching parameters in*_
statements.MATCH_ ANY -
Enhancement: Made
default_
a sync variable on all nodes.distributed_ ddl_ timeout -
Enhancement: Modified the conversion logic for converting from VECTOR to BSON types.
Now, when casting VECTOR(F32), it will generate a BSON array of doubles, rather than a combination of numeric types. -
Bugfix: Addressed a family of issues relating to optimal execution of JSON extracts on schema'd data.
2024-02-28 Version 8. 5. 9
-
Bugfix: Fixed an issue with regression in replay performance for databases with many tables.
2024-02-27 Version 8. 5. 8
-
Enhancement: Added spilling metrics for TopSort (
ORDER BY
withLIMIT
). -
Bugfix: Fixed an issue where the existing websocket connection would close when variables are updated in global scope.
-
Bugfix: Removed the hard-coded 'collation_
server' from constant.
.StrictModeParams -
Enhancement: Added new metrics to
memsql_
based on theexporter information_
columns.schema. mv_ sysinfo_ disk -
Enhancement: Added support for creating numeric histograms based on JSON values.
(Feature flag gated, contact your SingleStore representative) -
Enhancement: Added ability for
information_
to display JSON keys.schema. optimizer_ statistics -
Enhancement: Improved JSON histograms to support numeric histograms, analyze command,
info_
, and displays JSON histograms.schema. optimizer_ statistics -
Enhancement: Added support for warming blob cache with table's column data.
Syntax is: OPTIMIZE TABLE <table_
:name> WARM BLOB CACHE FOR COLUMN <column_ names> OPTIMIZE TABLE t WARM BLOB CACHE FOR COLUMN c1, c2;OPTIMIZE TABLE t WARM BLOB CACHE FOR COLUMN *; -
Enhancement: Added ability to skip eviction when log replaying hits the blob cache space limit, providing a greater chance to succeed.
-
Enhancement: Disabled the default semi join reduction rewrite.
-
Bugfix: Fixed an issue with a sensitive information leak inside of out-of-memory reports.
-
Bugfix: Fixed the result collation from
VECTOR
built-ins to beutf8mb4_
instead of binary.bin -
Enhancement: Creation of computed columns with VECTOR data type is now allowed.
-
Enhancement: Added support to the VECTOR built-ins for all VECTOR elements types (e.
g. , F32, F64, I8, I16, I32, and I64). -
Enhancement: Added support for usage of vector built-ins with string/JSON arguments without requiring an explicit typecast to VECTOR (e.
g. , 'SELECT @vec<*> '[1,2,3]'). -
Enhancement: Now recognize more
EXTRACT
/MATCH
functions as candidates for pushdown/computed column matching. -
Enhancement: Replaced expression pushdown (EPD) approach with more complete version that does not over project rows.
2024-02-20 Version 8. 5. 7
-
Bugfix: Fixed an issue with nested extracts in the
JSON_
statement.MATCH_ ANY() -
Bugfix: Fixed an issue with backup restore when the backup has a corrupted GV timestamp in the about snapshot record.
-
Enhancement: The new engine variable
parametrize_
allows JSON keys to be parametrized and plans can be reused.json_ keys -
Bugfix: Fixed an issue that causes
CREATE TABLES AS INFER PIPELINE
to fail with anOut Of Memory
error. -
Bugfix: Fixed an issue with exporter not working with Public-Key Cryptography Standards #8(PKCS#8) pem format.
-
Bugfix: Fixed an issue with potential crashes when specifying a vector index in index hint.
-
Bugfix: Fixed a crash that occurred when trying to grant access to the table with no context database in per-privilege mode.
-
Bugfix: Fixed a memory issue, when calling a Table-Valued Function (TVF) that has arguments with default values.
-
Bugfix: Fixed an issue with the RG pool selector function return type check.
The maximum value for n in VARCHAR(n) is now 256. -
Enhancement:
information_
now showsschema. mv_ connection_ attributes tls_
andversion tls_
for connections wherecipher SSL
is enabled.
2024-02-13 Version 8. 5. 6
-
Enhancement: Added ability for predicate pushdown with
NOW()
and user defined functions (UDF). -
Enhancement.
: Reduced amount of memory used by unlimited storage file listing, including point-in-time recovery (PITR). -
Enhancement.
Added an engine variable, innodb_
This variable exists for backwards compatibility with MySQL and is non-operational in SingleStore.lock_ wait_ timeout. -
Enhancement.
Optimized performance when using VECTOR
built-ins with theVECTOR
data type. -
Bugfix: Fixed an issue where a backup would inadvertently carry metadata about the retention period of the backed-up unlimited storage database.
-
Bugfix: Fixed the change to aggregator activity queries in
memsql_
not being applied properly.exporter
2024-02-07 Version 8. 5. 5
-
Enhancement: Added ability to
memsql_
to always return all sub-activities of an aggregator activity.exporter -
Enhancement: Improved ability to configure Kafka extract/egress by allowing additional options.
-
Enhancement: Improved performance for certain query shapes used by Kai.
-
Bugfix: Fixed the query-events endpoint link on the
memsql_
landing page.exporter -
Bugfix: Fixed an issue where a segmentation fault (crash) appeared after terminating a query on the remote node.
-
Bugfix: Fixed an issue with crashes occurring when using certain
JSON_
s in the predicate expression ofEXTRACT JSON_
.MATCH_ ANY() -
Bugfix: Fixed an issue where the number of rows affected with
SELECT INTO
object storage was erroneously reported as 0 rows. -
Bugfix: Fixed an issue with
START PIPELINE FOREGROUND
skipping files in some circumstances.
2024-01-29 Version 8. 5. 4
-
Enhancement: The new engine variable
max_
sets the maximum amount of memory required when creating or attaching a database.table_ memory_ room_ mb Configuring this engine variable allows more control over whether a detached database can be reattached. -
Bugfix: Fixed an optimization out-of-memory issue cause by operators generated for wide user tables.
-
Bugfix: Fixed a crash that occurs in rare scenarios involving
ALTER TABLE
and failovers. -
Bugfix: Fixed ineffective search options that change in subsequent vector search queries.
-
Bugfix: Resolved an issue related to
FROM_
andBASE64 TO_
builtins when processing large string inputs thereby preventing potential errors in reading communication packets.BASE64 -
Enhancement: The engine variable
backup_
maximum value has been increased to 15.multipart_ upload_ concurrency -
Bugfix: Fixed the code involved in backups to improve download error messaging.
-
Bugfix: Fixed an bug that could cause scans using non-unique indexes which could return incorrect results or cause crashes.
2024-01-23 Version 8. 5. 3
-
Bugfix: Fixed a bug that could result in unrecoverable databases if the database had 1024 or more tables.
2024-01-18 Version 8. 5. 2
-
Enhancement: Improved performance for
JSON_
built-ins inEXTRACT_ <type> ORDER BY
clauses. -
Enhancement: Added the
blob_
andcache_ miss_ b blob_
columns to the following information schema views:cache_ wait_ time_ ms information_
,schema. plancache information_
,schema. MV_ ACTIVITIES information_
,schema. MV_ ACTIVITIES_ CUMULATIVE information_
,schema. MV_ TASKS information_
, andschema. MV_ FINISHED_ TASKS information_
.schema. MV_ QUERY_ ACTIVITIES_ EXTENDED_ CUMULATIVE -
Bugfix: Fixed an issue where
INSERT.
queries with a. . SELECT partition_
filter generating an error.id() -
Bugfix: Fixed an issue with memory crashing when using
REGEXP_
,MATCH JSON_
, orINCLUDE_ MASK JSON_
built-ins.EXCLUDE_ MASK -
Enhancement:
INFER PIPELINE
for MongoDB® CDC-in now generates tables with BSON column types. -
Enhancement: Improved performance by optimizing joins on
TABLE(JSON_
queries.TO_ ARRAY()) -
Enhancement: Now suppressing a harmless
traceSuspiciousClockUpdate
trace message during recovery. -
Enhancement: Added the ability for users to kill queries on a remote node without the user having
PROCESS
privileges. -
Bugfix: Fixed an allocation issue that caused poor performance on high load insertion queries.
-
Enhancement: Enabled support for external UDFs used in
INSERT
statements with multipleVALUE
clauses. -
Enhancement: Added BSON fundamentals and column type support for SingleStore Kai.
Last modified: December 18, 2024