Functions
CQL supports 2 main categories of functions:
-
scalar functions that take a number of values and produce an output
-
aggregate functions that aggregate multiple rows resulting from a
SELECTstatement
In both cases, CQL provides a number of native "hard-coded" functions and also allows for the creation of custom user-defined functions.
|
By default, the use of user-defined functions is disabled by default for
security concerns (even when enabled, the execution of user-defined
functions is sandboxed and a "rogue" function should not be allowed to
do evil, but no sandbox is perfect so using user-defined functions is
opt-in). See the |
A function is identifier by its name:
function_name ::= [ keyspace_name'.' ] name
Scalar functions
Native functions
Cast
The cast function can be used to converts one native datatype to
another.
The following table describes the conversions supported by the cast
function. Cassandra will silently ignore any cast converting a datatype
into its own datatype.
| From | To |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
The conversions rely strictly on Java’s semantics. For example, the double value 1 will be converted to the text value '1.0'. For instance:
SELECT avg(cast(count as double)) FROM myTable;
Token
The token function computes the token for a given partition key.
The exact signature of the token function depends on the table concerned and the partitioner used by the cluster.
The type of the arguments of the token depend on the partition key column type. The returned type depends on the defined partitioner:
| Partitioner | Returned type |
|---|---|
Murmur3Partitioner |
|
RandomPartitioner |
|
ByteOrderedPartitioner |
|
For example, consider the following table:
CREATE TABLE users (
userid text PRIMARY KEY,
username text,
);
The table uses the default Murmur3Partitioner.
The token function uses the single argument text, because the partition key is userid of text type.
The returned type will be bigint.
Uuid
The uuid function takes no parameters and generates a random type 4
uuid suitable for use in INSERT or UPDATE statements.
Timeuuid functions
now
The now function takes no arguments and generates, on the coordinator
node, a new unique timeuuid at the time the function is invoked. Note
that this method is useful for insertion but is largely nonsensical in
WHERE clauses.
For example, a query of the form:
SELECT * FROM myTable WHERE t = now();
will not return a result, by design, since the value returned by
now() is guaranteed to be unique.
current_timeuuid is an alias of now.
min_timeuuid and max_timeuuid
The min_timeuuid function takes a timestamp value t, either a timestamp or a date string.
It returns a fake timeuuid corresponding to the smallest possible timeuuid for timestamp t.
The max_timeuuid works similarly, but returns the largest possible timeuuid.
For example:
SELECT * FROM myTable
WHERE t > max_timeuuid('2013-01-01 00:05+0000')
AND t < min_timeuuid('2013-02-02 10:00+0000');
will select all rows where the timeuuid column t is later than '2013-01-01 00:05+0000' and earlier than '2013-02-02 10:00+0000'.
The clause t >= maxTimeuuid('2013-01-01 00:05+0000') would still not select a timeuuid generated exactly at '2013-01-01 00:05+0000', and is essentially equivalent to t > maxTimeuuid('2013-01-01 00:05+0000').
|
The values generated by |
Datetime functions
Retrieving the current date and time:
| Function name | Output type |
|---|---|
|
|
|
|
|
|
|
|
For example the last two days of data can be retrieved using:
SELECT * FROM myTable WHERE date >= current_date() - 2d;
Time conversion functions
A number of functions are provided to convert a timeuuid, a timestamp or a date into another native type.
| Function name | Input type | Description |
|---|---|---|
|
|
Converts the |
|
|
Converts the |
|
|
Converts the |
|
|
Converts the |
|
|
Converts the |
|
|
Converts the |
|
|
Converts the |
For example, a timestamp can be converted to a date with the following:
SELECT id, to_date(create_ts) FROM myTable
Blob conversion functions
A number of functions are provided to convert the native types into
binary data, or a blob.
For every type supported by CQL, the function type_as_blob takes an argument of type type and returns it as a blob.
Conversely, the function blob_as_type takes a 64-bit blob argument and converts it to a bigint value.
For example, bigint_as_blob(3) returns 0x0000000000000003 and blob_as_bigint(0x0000000000000003) returns 3.
Length Functions
CQL supports two functions to retrieve the length of data without returning the data itself. Note that while network bandwidth is reduced and memory is freed earlier, these functions still require data to be read from disk.
| Function name | Input type | Description |
|---|---|---|
|
All types |
Returns the length of the data in bytes. |
|
|
Returns the string’s length - the count of UTF-8 code units. |
The octet_length function is defined for every type
supported by CQL, and represents the number of bytes of the underlying ByteBuffer representation, not accounting for
metadata overhead. Equivalent to Java’s
ByteBuffer#remaining()
when data has just been read, which is also the length of the type when encoded to byte[]. Some examples
for common types:
| CQL Type | octet_length |
Description |
|---|---|---|
|
|
8-bit signed integer |
|
|
16-bit signed integer |
|
|
32-bit signed integer |
|
|
64-bit signed integer |
|
|
32-bit IEEE-754 floating point |
|
|
64-bit IEEE-754 floating point |
|
Number of bytes in blob |
Variable length byte string |
|
Number of bytes in |
Variable length character string |
The length function is only defined for UTF-8 strings (text) and returns the length of that string, meaning the
number of UTF-8 code units. Equivalent to Java’s
String#length() or
Python 3’s len function when applied to a string.
These length functions return null when the input is null.
Math Functions
Cql provides the following math functions: abs, exp, log, log10, and round.
The return type for these functions is always the same as the input type.
| Function name | Description |
|---|---|
|
Returns the absolute value of the input. |
|
Returns the number e to the power of the input. |
|
Returns the natural log of the input. |
|
Returns the log base 10 of the input. |
|
Rounds the input to the nearest whole number using rounding mode |
Collection functions
A number of functions are provided to operate on collection columns.
| Function name | Input type | Description |
|---|---|---|
|
|
Gets the keys of the |
|
|
Gets the values of the |
|
|
Gets the number of elements in the collection argument. |
|
|
Gets the minimum element in the collection argument. |
|
|
Gets the maximum element in the collection argument. |
|
numeric |
Computes the sum of the elements in the collection argument. The returned value is of the same type as the input collection elements, so there is a risk of overflowing the data type if the sum of the values exceeds the maximum value that the type can represent. |
|
numeric |
Computes the average of the elements in the collection argument. The average of an empty collection returns zero. The returned value is of the same type as the input collection elements, which might include rounding and truncations. For example |
Data masking functions
A number of functions allow to obscure the real contents of a column containing sensitive data.
| Function | Description |
|---|---|
|
Replaces the first argument with a Examples:
|
|
Replaces its argument by an arbitrary, fixed default value of the same type.
This will be Variable-length multi-valued types such as lists, sets and maps are masked as empty collections. Fixed-length multi-valued types such as tuples, user-defined types (UDTs) and vectors are masked by replacing each of their values by the default masking value of the value type. Examples:
|
|
Replaces the first argument by the replacement value on the second argument. The replacement value needs to have the same type as the replaced value. Examples:
|
|
Returns a copy of the first Examples:
|
|
Returns a copy of the first Examples:
|
|
Returns a Examples:
|
Vector similarity functions
A number of functions allow to obtain the similarity score between vectors of floats.
| Function | Description |
|---|---|
|
Calculates the cosine similarity score between two float vectors of the same dimension. Examples:
|
|
Calculates the euclidian distance between two float vectors of the same dimension. Examples:
|
|
Calculates the dot product between two float vectors of the same dimension. Examples:
|
Human helper functions
For user’s convenience, there are currently two functions which are converting values to more human-friendly representations.
| Function name | Input type | Description |
|---|---|---|
|
|
Converts values in bytes to a more human-friendly representation. |
|
|
Converts values in milliseconds to a more human-friendly representation. |
format_bytes
This function looks at values in a column as if it was in bytes, and it will convert it to whatever a user pleases. Supported units are: B, KiB, MiB and GiB. The result will be rounded to two decimal places.
Supported column types on which this function is possible to be applied:
INT, TINYINT, SMALLINT, BIGINT, VARINT, ASCII, TEXT.
For ASCII and TEXT types, text of such column has to be a non-negative number.
Return values can be max of Long.MAX_VALUE, If the conversion produces overflown value, Long.MAX_VALUE will be returned.
|
The actual return value of the |
There are three ways how to call this function. Let’s have this table:
cqlsh> select * from ks.tb;
id | val
----+----------------
5 | 60000
1 | 1234234
2 | 12342341234234
4 | 60001
7 | null
6 | 43
3 | 123423
with schema
CREATE TABLE ks.tb (
id int PRIMARY KEY,
val bigint
);
Imagine that we wanted to look at val values as if they were in mebibytes. We would like to have more human-friendly output in order to not visually divide the values by 1024 in order to get them in respective bigger units. The following function call may take just a column itself as an argument, and it will
automatically convert it.
|
The default source unit for |
cqlsh> select format_bytes(val) from ks.tb;
system.format_bytes(val)
--------------------------
58.59 KiB
1.18 MiB
11494.7 GiB
58.59 KiB
null
43 B
120.53 KiB
The second way to call format_bytes functions is to specify into what size unit we would like to see all
values to be converted to. For example, we want all size to be represented in mebibytes, hence we do:
cqlsh> select format_bytes(val, 'MiB') from ks.tb;
system.format_bytes(val, 'MiB')
----------------------------------
0.06 MiB
1.18 MiB
11770573.84 MiB
0.06 MiB
null
0 MiB
0.12 MiB
Lastly, we can specify a source unit and a target unit. A source unit tells what unit that column is logically of, the target unit tells what unit we want these values to be converted to. For example, if our column values are in kibibytes and we want to convert them to mebibytes, we would perform the following conversion:
cqlsh> select format_bytes(val, 'Kib', 'MiB') from ks.tb;
system.format_bytes(val, 'KiB', 'MiB')
----------------------------------------
58.59 MiB
1205.31 MiB
12053067611.56 MiB
58.59 MiB
null
0.04 MiB
120.53 MiB
format_time
Similarly to format_bytes, we can do transformations on duration-like columns.
Supported units are: d, h, m, s, ms, us, µs, ns.
Supported column types on which this function is possible to be applied:
INT, TINYINT, SMALLINT, BIGINT, VARINT, ASCII, TEXT. For ASCII and TEXT types, text of such column has to be a non-negative number.
Return values can be max of Double.MAX_VALUE, If the conversion produces overflown value, Double.MAX_VALUE will be returned.
|
The default source unit for |
cqlsh> select format_time(val) from ks.tb;
system.format_time(val)
-------------------------
1 m
20.57 m
142851.17 d
1 m
null
43 ms
2.06 m
We may specify what unit we want that value to be converted to, give the column’s values are in milliseconds:
cqlsh> select format_time(val, 'm') from ks.tb;
system.format_time(val, 'm')
------------------------------
1 m
20.57 m
205705687.24 m
1 m
null
0 m
2.06 m
Lastly, we can specify both source and target values:
cqlsh> select format_time(val, 's', 'h') from ks.tb;
system.format_time(val, 's', 'h')
-----------------------------------
16.67 h
342.84 h
3428428120.62 h
16.67 h
null
0.01 h
34.28 h
User-defined functions
User-defined functions (UDFs) execute user-provided code in Cassandra. By default, Cassandra supports defining functions in Java.
UDFs are part of the Cassandra schema, and are automatically propagated to all nodes in the cluster. UDFs can be overloaded, so that multiple UDFs with different argument types can have the same function name.
|
JavaScript user-defined functions have been deprecated in Cassandra 4.1. In preparation for Cassandra 5.0, their removal is already in progress. For more information - CASSANDRA-17281, CASSANDRA-18252. |
For example:
CREATE FUNCTION sample ( arg int ) ...;
CREATE FUNCTION sample ( arg text ) ...;
User-defined functions (UDFs) are prone to the typical issues associated with the programming language they are written in.
Accordingly, implementations should be protected against null pointer exceptions, illegal arguments, or any other potential source of exceptions.
An exception during function execution will result in the entire statement failing.
Valid queries for UDF use are SELECT, INSERT and UPDATE statements.
Complex types like collections, tuple types and user-defined types are valid argument and return types in UDFs. Tuple types and user-defined types use the DataStax Java Driver conversion functions. Please see the Java Driver documentation for details on handling tuple types and user-defined types.
Arguments for functions can be literals or terms. Prepared statement placeholders can be used, too.
Note the use the double dollar-sign syntax to enclose the UDF source code.
For example:
CREATE FUNCTION some_function ( arg int )
RETURNS NULL ON NULL INPUT
RETURNS int
LANGUAGE java
AS $$ return arg; $$;
SELECT some_function(column) FROM atable ...;
UPDATE atable SET col = some_function(?) ...;
CREATE TYPE custom_type (txt text, i int);
CREATE FUNCTION fct_using_udt ( udtarg frozen )
RETURNS NULL ON NULL INPUT
RETURNS text
LANGUAGE java
AS $$ return udtarg.getString("txt"); $$;
The implicitly available udfContext field (or binding for script UDFs) provides the necessary functionality to create new UDT and tuple values:
CREATE TYPE custom_type (txt text, i int);
CREATE FUNCTION fct\_using\_udt ( somearg int )
RETURNS NULL ON NULL INPUT
RETURNS custom_type
LANGUAGE java
AS $$
UDTValue udt = udfContext.newReturnUDTValue();
udt.setString("txt", "some string");
udt.setInt("i", 42);
return udt;
$$;
The definition of the UDFContext interface can be found in the Apache Cassandra source code for org.apache.cassandra.cql3.functions.UDFContext.
public interface UDFContext
{
UDTValue newArgUDTValue(String argName);
UDTValue newArgUDTValue(int argNum);
UDTValue newReturnUDTValue();
UDTValue newUDTValue(String udtName);
TupleValue newArgTupleValue(String argName);
TupleValue newArgTupleValue(int argNum);
TupleValue newReturnTupleValue();
TupleValue newTupleValue(String cqlDefinition);
}
Java UDFs already have some imports for common interfaces and classes defined. These imports are:
import java.nio.ByteBuffer;
import java.util.List;
import java.util.Map;
import java.util.Set;
import org.apache.cassandra.cql3.functions.UDFContext;
import com.datastax.driver.core.TypeCodec;
import com.datastax.driver.core.TupleValue;
import com.datastax.driver.core.UDTValue;
Please note, that these convenience imports are not available for script UDFs.
CREATE FUNCTION statement
Creating a new user-defined function uses the CREATE FUNCTION statement:
create_function_statement::= CREATE [ OR REPLACE ] FUNCTION [ IF NOT EXISTS]
function_name '(' arguments_declaration ')'
[ CALLED | RETURNS NULL ] ON NULL INPUT
RETURNS cql_type
LANGUAGE identifier
AS string arguments_declaration: identifier cql_type ( ',' identifier cql_type )*
For example:
CREATE OR REPLACE FUNCTION somefunction(somearg int, anotherarg text, complexarg frozen<someUDT>, listarg list)
RETURNS NULL ON NULL INPUT
RETURNS text
LANGUAGE java
AS $$
// some Java code
$$;
CREATE FUNCTION IF NOT EXISTS akeyspace.fname(someArg int)
CALLED ON NULL INPUT
RETURNS text
LANGUAGE java
AS $$
// some Java code
$$;
CREATE FUNCTION with the optional OR REPLACE keywords creates either a function or replaces an existing one with the same signature.
A CREATE FUNCTION without OR REPLACE fails if a function with the same signature already exists.
If the optional IF NOT EXISTS keywords are used, the function will only be created only if another function with the same signature does not
exist.
OR REPLACE and IF NOT EXISTS cannot be used together.
Behavior for null input values must be defined for each function:
-
RETURNS NULL ON NULL INPUTdeclares that the function will always returnnullif any of the input arguments isnull. -
CALLED ON NULL INPUTdeclares that the function will always be executed.
Function Signature
Signatures are used to distinguish individual functions. The signature consists of a fully-qualified function name of the <keyspace>.<function_name> and a concatenated list of all the argument types.
Note that keyspace names, function names and argument types are subject to the default naming conventions and case-sensitivity rules.
Functions belong to a keyspace; if no keyspace is specified, the current keyspace is used. User-defined functions are not allowed in the system keyspaces.
DROP FUNCTION statement
Dropping a function uses the DROP FUNCTION statement:
drop_function_statement::= DROP FUNCTION [ IF EXISTS ] function_name [ '(' arguments_signature ')' ]
arguments_signature::= cql_type ( ',' cql_type )*
For example:
DROP FUNCTION myfunction;
DROP FUNCTION mykeyspace.afunction;
DROP FUNCTION afunction ( int );
DROP FUNCTION afunction ( text );
You must specify the argument types of the function, the arguments_signature, in the drop command if there are multiple overloaded functions with the same name but different signatures.
DROP FUNCTION with the optional IF EXISTS keywords drops a function if it exists, but does not throw an error if it doesn’t.
Aggregate functions
Aggregate functions work on a set of rows. Values for each row are input, to return a single value for the set of rows aggregated.
If normal columns, scalar functions, UDT fields, writetime, or ttl are selected together with aggregate functions, the values
returned for them will be the ones of the first row matching the query.
Native aggregates
Count
The count function can be used to count the rows returned by a query.
For example:
SELECT COUNT (*) FROM plays;
SELECT COUNT (1) FROM plays;
It also can count the non-null values of a given column:
SELECT COUNT (scores) FROM plays;
Max and Min
The max and min functions compute the maximum and the minimum value returned by a query for a given column.
For example:
SELECT MIN (players), MAX (players) FROM plays WHERE game = 'quake';
Sum
The sum function sums up all the values returned by a query for a given column.
The returned value is of the same type as the input collection elements, so there is a risk of overflowing if the sum of the values exceeds the maximum value that the type can represent.
For example:
SELECT SUM (players) FROM plays;
The returned value is of the same type as the input values, so there is a risk of overflowing the type if the sum of the values exceeds the maximum value that the type can represent. You can use type casting to cast the input values as a type large enough to contain the type. For example:
SELECT SUM (CAST (players AS VARINT)) FROM plays;
Avg
The avg function computes the average of all the values returned by a query for a given column.
For example:
SELECT AVG (players) FROM plays;
The average of an empty collection returns zero.
The returned value is of the same type as the input values, which might include rounding and truncations.
For example collection_avg([1, 2]) returns 1 instead of 1.5.
You can use type casting to cast to a type with the desired decimal precision. For example:
SELECT AVG (CAST (players AS FLOAT)) FROM plays;
User-Defined Aggregates (UDAs)
User-defined aggregates allow the creation of custom aggregate functions.
User-defined aggregates can be used in SELECT statement.
Each aggregate requires an initial state of type STYPE defined with the INITCOND`value (default value: `null).
The first argument of the state function must have type STYPE.
The remaining arguments of the state function must match the types of the user-defined aggregate arguments.
The state function is called once for each row, and the value returned by the state function becomes the new state.
After all rows are processed, the optional FINALFUNC is executed with last state value as its argument.
The STYPE value is mandatory in order to distinguish possibly overloaded versions of the state and/or final function, since the
overload can appear after creation of the aggregate.
A complete working example for user-defined aggregates (assuming that a
keyspace has been selected using the USE statement):
CREATE OR REPLACE FUNCTION test.averageState(state tuple<int,bigint>, val int)
CALLED ON NULL INPUT
RETURNS tuple
LANGUAGE java
AS $$
if (val != null) {
state.setInt(0, state.getInt(0)+1);
state.setLong(1, state.getLong(1)+val.intValue());
}
return state;
$$;
CREATE OR REPLACE FUNCTION test.averageFinal (state tuple<int,bigint>)
CALLED ON NULL INPUT
RETURNS double
LANGUAGE java
AS $$
double r = 0;
if (state.getInt(0) == 0) return null;
r = state.getLong(1);
r /= state.getInt(0);
return Double.valueOf(r);
$$;
CREATE OR REPLACE AGGREGATE test.average(int)
SFUNC averageState
STYPE tuple
FINALFUNC averageFinal
INITCOND (0, 0);
CREATE TABLE test.atable (
pk int PRIMARY KEY,
val int
);
INSERT INTO test.atable (pk, val) VALUES (1,1);
INSERT INTO test.atable (pk, val) VALUES (2,2);
INSERT INTO test.atable (pk, val) VALUES (3,3);
INSERT INTO test.atable (pk, val) VALUES (4,4);
SELECT test.average(val) FROM atable;
CREATE AGGREGATE statement
Creating (or replacing) a user-defined aggregate function uses the
CREATE AGGREGATE statement:
create_aggregate_statement ::= CREATE [ OR REPLACE ] AGGREGATE [ IF NOT EXISTS ]
function_name '(' arguments_signature')'
SFUNC function_name
STYPE cql_type:
[ FINALFUNC function_name]
[ INITCOND term ]
See above for a complete example.
The CREATE AGGREGATE command with the optional OR REPLACE keywords creates either an aggregate or replaces an existing one with the same
signature.
A CREATE AGGREGATE without OR REPLACE fails if an aggregate with the same signature already exists.
The CREATE AGGREGATE command with the optional IF NOT EXISTS keywords creates an aggregate if it does not already exist.
The OR REPLACE and IF NOT EXISTS phrases cannot be used together.
The STYPE value defines the type of the state value and must be specified.
The optional INITCOND defines the initial state value for the aggregate; the default value is null.
A non-null INITCOND must be specified for state functions that are declared with RETURNS NULL ON NULL INPUT.
The SFUNC value references an existing function to use as the state-modifying function.
The first argument of the state function must have type STYPE.
The remaining arguments of the state function must match the types of the user-defined aggregate arguments.
The state function is called once for each row, and the value returned by the state function becomes the new state.
State is not updated for state functions declared with RETURNS NULL ON NULL INPUT and called with null.
After all rows are processed, the optional FINALFUNC is executed with last state value as its argument.
It must take only one argument with type STYPE, but the return type of the FINALFUNC may be a different type.
A final function declared with RETURNS NULL ON NULL INPUT means that the aggregate’s return value will be null, if the last state is null.
If no FINALFUNC is defined, the overall return type of the aggregate function is STYPE.
If a FINALFUNC is defined, it is the return type of that function.
DROP AGGREGATE statement
Dropping a user-defined aggregate function uses the DROP AGGREGATE
statement:
drop_aggregate_statement::= DROP AGGREGATE [ IF EXISTS ] function_name[ '(' arguments_signature ')'
]
For instance:
DROP AGGREGATE myAggregate;
DROP AGGREGATE myKeyspace.anAggregate;
DROP AGGREGATE someAggregate ( int );
DROP AGGREGATE someAggregate ( text );
The DROP AGGREGATE statement removes an aggregate created using CREATE AGGREGATE.
You must specify the argument types of the aggregate to drop if there are multiple overloaded aggregates with the same name but a
different signature.
The DROP AGGREGATE command with the optional IF EXISTS keywords drops an aggregate if it exists, and does nothing if a function with the
signature does not exist.
WRITETIME, MINWRITETIME, MAXWRITETIME and TTL functions
These metadata functions are only allowed in SELECT statements: WRITETIME, MINWRITETIME, MAXWRITETIME and TTL.
The functions take only one argument, a column name, and retrieve metadata stored internally for the column. If the column is a collection or UDT, it’s possible to add element
selectors, such as WRITETTIME(phones[2..4]) or WRITETTIME(user.name).
-
WRITETIMEstores the timestamp of the value of the column. -
MINWRITETIMEstores the smallest timestamp of the value of the column. For non-collection and non-UDT columns,MINWRITETIMEis equivalent toWRITETIME. In the other cases, it returns the smallest timestamp of the values in the column. -
MAXWRITETIMEstores the largest timestamp of the value of the column. For non-collection and non-UDT columns,MAXWRITETIMEis equivalent toWRITETIME. In the other cases, it returns the largest timestamp of the values in the column. -
TTLstores the remaining time to live (in seconds) for the value of the column if it is set to expire; otherwise the value isnull.
The WRITETIME and TTL functions can be used on multi-cell columns such as non-frozen collections or non-frozen
user-defined types. In that case, the functions will return the list of timestamps or TTLs for each selected cell.
