Skip to content
couchsetPublic

Repository files navigation

CouchSet

NPM
CouchSet’s red couch mascot among neatly arranged data blocks.

CouchSet is a Couchbase model layer for TypeScript and Node.js. The default couchset entrypoint keeps the legacy API for safe upgrades; the modern API is available from couchset/next.

The additive client-owned primitives—typed definitions, explicit provisioning, transaction-bound models, CAS helpers, safe index plans, and Eventing—are summarized below. Their complete operational guide is Next primitives.

Install

npm i couchset --save

Legacy Default

Existing projects can keep importing from couchset and continue using the old model methods while gradually migrating.

import {couchset, Model} from 'couchset';

await couchset({
    connectionString: process.env.COUCHBASE_URL || 'couchbase://localhost',
    username: process.env.COUCHBASE_USERNAME || 'admin',
    password: process.env.COUCHBASE_PASSWORD || '1234',
    bucketName: process.env.COUCHBASE_BUCKET || 'dev',
});

const users = new Model('User', {schema: {createdAt: 'date'}});

const created = await users.create({
    userId: 'ceddy',
    email: 'ceddy@example.com',
});

const found = await users.findById(created.id);
await users.updateById(created.id, {...found, email: 'new@example.com'});
await users.delete(created.id);

Modern API

New code can opt into the modern API with couchset/next.

import {couchset, Model} from 'couchset/next';

type User = {
    userId: string;
    email?: string;
};

const users = new Model('User', {
    schema: {
        createdAt: 'date',
        updatedAt: 'date',
    },
    indexes: [
        {
            name: 'idx_user_userId',
            fields: ['userId'],
        },
    ],
});

await couchset({
    connectionString: process.env.COUCHBASE_URL || 'couchbase://localhost',
    username: process.env.COUCHBASE_USERNAME || 'admin',
    password: process.env.COUCHBASE_PASSWORD || '1234',
    bucketName: process.env.COUCHBASE_BUCKET || 'dev',
});

await couchset.ready();

const created = await users.insert<User>({
    userId: 'ceddy',
    email: 'ceddy@example.com',
});

const found = await users.getById<User>(created.id);

const patched = await users.patchById<User>(created.id, {
    $set: {email: 'new@example.com'},
});

const page = await users.page<User>({
    where: {userId: {$eq: 'ceddy'}},
    limit: 25,
    page: 0,
});

await users.deleteById(created.id, {hard: true});

Modern Client Primitives

Additional opt-in APIs: model plugins, scopes, hooks and keys, Search, vector and geospatial queries, and bulk operations, instrumentation and the CLI.

couchset/next also offers a client-owned API for typed manifests, explicit administrative work, safe operational plans, and Eventing. These are deliberately separate from the singleton Model API above.

Declarative models

import {createCouchsetClient, defineModel} from 'couchset/next';

const sessions = defineModel({name: 'Session', scope: 'auth', collection: 'sessions'});
const db = createCouchsetClient({bucketName: 'app', models: [sessions]});
const sessionModel = db.model(sessions); // registers and binds; no DDL

Read the full client and model-definition guide.

Provisioning and dynamic models

await db.ensureCollections(); // creates only missing scopes and collections
await db.ensureIndexes();     // create-only index DDL

const reports = await db.registerModel(reportDefinition, {provision: {collections: true}});

Read about provisioning and dynamic models.

Transactions and CAS

await db.transaction(async (tx) => {
    await tx.model(sessions).insert({id: 'session::1', userId: 'user::1'});
});

const outcome = await sessionModel.consumeOnce('session::1', knownCas);

Read the transaction and CAS safety notes.

Safe index plans

const plan = await db.planIndexes(); // inspect missing, matching, and drifted indexes
await db.applyIndexPlan(plan);        // creates safe replacements and waits for them

Read about index drift and opt-in cleanup.

Eventing functions

import {defineEventingFunction} from 'couchset/next';

const auditOrders = defineEventingFunction({
    name: 'audit_orders',
    code: 'function OnUpdate(doc, meta) { log(meta.id); }',
    sourceKeyspace: {bucket: 'app', scope: 'sales', collection: 'orders'},
});

const eventing = db.eventing({
    namespace: 'billing',
    metadataKeyspace: {bucket: 'app', scope: 'eventing', collection: 'billing_metadata'},
    definitions: [auditOrders],
});

await eventing.apply();

Read the Eventing lifecycle and safety guide.

Test fixtures

import {createCouchsetTestFixture} from 'couchset/next';

const {model, cleanup} = await createCouchsetTestFixture(db, {name: 'Invoice'});
// use model in the test
await cleanup();

Read about isolated CouchSet test fixtures.

Connection Lifecycle

Models can be declared before connecting. Model operations wait for the shared connection before binding to the Couchbase bucket and collection.

import {couchset, health, ping, ready, shutdown} from 'couchset/next';

await couchset({
    connectionString: 'couchbase://localhost',
    username: 'admin',
    password: '1234',
    bucketName: 'dev',
    autoReconnect: true,
    reconnectIntervalMs: 5000,
});

await ready();
await ping();
console.log(health());

await shutdown();

Reconnect is enabled by default. Environment flags:

  • COUCHSET_RECONNECT: use false, 0, or no to disable reconnect.
  • COUCHSET_RECONNECT_INTERVAL_MS: reconnect and health-check interval in milliseconds. Default is 5000.

The modern entrypoint also exports app starter helpers that read Couchbase credentials from env:

import {startCouchbase, startCouchbaseServerless} from 'couchset/next';

await startCouchbase();
await startCouchbaseServerless();

The starters accept one PostgreSQL-style DB_URL in place of the four connection settings. It takes precedence over COUCHBASE_URL, COUCHBASE_BUCKET, COUCHBASE_USERNAME, and COUCHBASE_PASSWORD; explicit startCouchbase({...}) options still take precedence over either environment form.

DB_URL=couchbase://user:password@localhost/bucket
DB_URL=couchbase://user:password@localhost:11210/bucket
DB_URL=couchbases://user:password@cb.example.com/bucket

Use couchbases:// for TLS. Percent-encode reserved characters in usernames, passwords, and bucket names (for example, p%40ss for p@ss). COUCHBASE_PROXY remains available as a separate optional setting.

Models

const auditEvents = new Model('AuditEvent', {
    scope: 'app',
    collection: 'events',
    softDelete: true,
    defaultWhere: {tenantId: {$eq: 'tenant-1'}},
    dateFields: ['profile.createdAt'],
    validateCreate: (doc) => doc,
    validateReplace: (doc) => doc,
    parse: (doc) => doc,
});

Useful model helpers:

users.bucket(); // `dev`
users.keyspace(); // `dev` or default:`dev`.`scope`.`collection`
users.from('u'); // `dev` AS u

For large objects, keep list metadata and heavy payloads in separate models. See Document Modeling for the recommended read shape.

Reads

await users.getById<User>('user::1');
await users.findByIdWithMeta<User>('user::1');

await users.findMany<User>({
    select: ['id', 'userId', 'email'],
    where: {userId: {$eq: 'ceddy'}},
    orderBy: {createdAt: 'DESC'},
    limit: 10,
});

await users.findOne<User>({where: {email: {$eq: 'ceddy@example.com'}}});
await users.exists({where: {userId: {$eq: 'ceddy'}}});
await users.count({where: {userId: {$eq: 'ceddy'}}});

const result = await users.page<User>({
    where: {userId: {$eq: 'ceddy'}},
    limit: 10,
    page: 0,
});

result.items;
result.hasNext;
result.pageInfo.nextPage;

Hydrated documents:

const doc = await users.findDocById<User & {id: string}>('user::1');

doc.email = 'updated@example.com';
await doc.save();
await doc.patch({$set: {verified: true}});
await doc.reload();
await doc.delete({hard: true});

Soft delete scopes:

await users.softDeleteById<User>('user::1');
await users.restoreById<User>('user::1');

await users.withDeleted().findMany<User>();
await users.onlyDeleted().findMany<User>();
await users.withoutDefaultWhere().findMany<User>();

Typed Joins and Read Consistency

Client-bound models infer root and related fields. Using the client-owned db above, join profiles to battles by arbitrary fields:

import {dateCodec, defineModel, joinField} from 'couchset/next';
import {QueryScanConsistency} from 'couchbase';

const battles = db.model(defineModel<{
    createdByUserId: string;
    startsAt: Date;
}>({name: 'Battle', scope: 'app', collection: 'battles', codecs: {startsAt: dateCodec}}));

const profiles = db.model(defineModel<{
    ownerUserId: string;
    displayName: string;
    birthday: Date;
}>({name: 'Profile', scope: 'app', collection: 'profiles', codecs: {birthday: dateCodec}}));

const joined = await battles.page({
    sourceAlias: 'battle',
    include: [{
        as: 'creator',
        model: profiles,
        type: 'leftJoin',
        on: {
            left: joinField('creator.ownerUserId'),
            op: '$eq',
            right: joinField('battle.createdByUserId'),
        },
    }],
    limit: 20,
    queryOptions: {scanConsistency: QueryScanConsistency.RequestPlus},
});

joined.items[0]?.startsAt;          // Date | undefined
joined.items[0]?.creator?.birthday; // Date | undefined; related codec applied

Provision the collections and appropriate indexes explicitly before querying. joinField() denotes a field reference; an ordinary string is a bound value. Use $and / $or to combine predicates. Existing key / keys includes still use ON KEYS.

Use NEST for arrays, and select just the fields needed:

const summaries = await battles.findMany({
    select: ['startsAt'],
    include: [{
        as: 'creators',
        model: profiles,
        type: 'leftNest',
        on: {left: joinField('creators.ownerUserId'), op: '$eq', right: joinField('doc.createdByUserId')},
        select: ['displayName', 'birthday'],
    }],
});
// {startsAt: Date; creators: {displayName: string; birthday: Date}[]}[]

LEFT JOIN may omit its related property; LEFT NEST returns [] when unmatched. JOIN preserves one row per match, including repeated root IDs. Choose an alias that does not overwrite a root field. NEST does not promise source-key ordering.

For read-your-writes, pass tokens from successful SDK mutations:

import {MutationState, MutationToken} from 'couchbase';

async function readAfterWrites(tokens: MutationToken[]) {
    return battles.findMany({
        queryOptions: {consistentWith: new MutationState(...tokens)},
    });
}
// Call with SDK mutationResult.token values, not whole mutation results.

request_plus and consistentWith are alternatives; neither is a multi-document transaction. Defaults are unchanged when no consistency option is supplied. See joined reads and consistency for predicates, projection limits, codecs, compatibility changes, and live validation results.

Writes

await users.insert<User>({id: 'user::1', userId: 'ceddy'});
await users.upsert<User>({id: 'user::1', userId: 'ceddy'});
await users.replaceById<User>('user::1', {userId: 'ceddy', email: 'new@example.com'});
await users.patchById<User>('user::1', {
    $set: {email: 'new@example.com'},
    $inc: {loginCount: 1},
    $unset: ['temporaryCode'],
});
await users.incrementById<User>('user::1', 'loginCount', 1);
await users.deleteById('user::1', {hard: true});

TTL helpers:

await users.insert<User>({id: 'user::1', userId: 'ceddy'}, {ttl: '2h'});
await users.upsert<User>({id: 'user::2', userId: 'ceddy'}, {ttlSeconds: 300});

Queries

Modern query helpers pass SDK parameters correctly and throw on failures by default.

const rows = await users.queryRows<User>(
    `SELECT u.* FROM ${users.from('u')} WHERE u.userId=$userId LIMIT $limit`,
    {userId: 'ceddy', limit: 10}
);

const first = await users.queryOne<User>(
    `SELECT u.* FROM ${users.from('u')} WHERE u.email=$email LIMIT 1`,
    {email: 'ceddy@example.com'}
);

const page = await users.queryPage<User>(
    `SELECT u.* FROM ${users.from('u')} WHERE u.userId=$userId LIMIT $limit`,
    {userId: 'ceddy', limit: 10}
);

Model read helpers also throw by default. Use throwOnError: false only when an empty fallback is intentional.

const rows = await users.findMany<User>({
    where: {userId: {$eq: 'ceddy'}},
    throwOnError: false,
});

Indexes

const users = new Model('User', {
    indexes: [
        {
            name: 'idx_user_email',
            fields: ['email'],
            where: {deleted: {$isNotValued: true}},
        },
    ],
});

await users.ensureIndexes();
await couchset.ensureIndexes();

Includes

const posts = new Model('Post');

const rows = await posts.findMany({
    where: {published: {$eq: true}},
    include: [
        {
            as: 'author',
            model: users,
            key: 'authorId',
            type: 'leftJoin',
        },
    ],
});

Time Series

import {TimeSeriesModel} from 'couchset/next';

const metrics = new TimeSeriesModel('Metric', {
    keyField: 'deviceId',
    timeField: 'timestamp',
    values: [{field: 'temperature'}],
    interval: '1m',
});

await metrics.appendChunk('device-1', [
    {deviceId: 'device-1', timestamp: Date.now(), temperature: 21.5},
]);

Gradual Migration

Use couchset for old code and couchset/next for new code. Both model APIs share the same connection singleton, reconnect loop, and health state, so you can migrate one model or file at a time without opening a second Couchbase cluster connection.

import {couchset, Model} from 'couchset';
import {Model as NextModel} from 'couchset/next';

await couchset(args);

const legacyUsers = new Model('User');
const nextUsers = new NextModel('User');

couchset/legacy remains available as an explicit alias for the default legacy API.

Modern replacements:

Old method Modern method
create() insert() or upsert()
findById() getById()
updateById() / save() replaceById() or patchById()
delete() deleteById()
pagination() findMany() or page()
customQuery() queryRows(), queryOne(), or queryPage()

Local Tests

npm run build
npm test
npm run test:serverless

Set COUCHBASE_URL, COUCHBASE_BUCKET, COUCHBASE_USERNAME, and COUCHBASE_PASSWORD to point the integration tests at a local Couchbase instance.

License

CouchSet is MIT licensed.

Releases

Sponsor this project

Used by

Contributors

Languages