jetc: add #api directive + jetc_api_<name> route metadata export

Stage 1 of the APIServer plan: a compiled --shared .so currently exports
only a bare jetc_render_<name>(Global&, MString&) with no way for a host
to discover what HTTP method+path it wants to serve. Adds a leading
"#api METHOD /path" directive (one or more, parsed the same way jetc
already strips a leading "#!" shebang line - not modeled as a new
AST/tag-attribute concept, since jetc's parser has no existing notion of
the enclosing <jet> tag's attributes to hang this off of).

In --shared mode, JetCodegen now also emits a second exported function
alongside the render entry point:

  struct JetApiRoute { const char *method; const char *path; };
  extern "C" const JetApiRoute *jetc_api_<name>(int *count) { ... }

<name> is derived the same way for both symbols (sanitizeIdent(
baseNameNoExt(inputPath))), so a future host loader can find both by
convention from just the .so's filename - no name needs to be embedded
in the metadata itself, and the routes a module declares can never drift
out of sync with the render function that implements them (the failure
mode a sidecar manifest file would have).

Malformed directives (missing method/path, path without a leading '/')
are a hard compile error; #api directives present without --shared print
a non-fatal warning (the metadata has nowhere to go without a host to
load a .so, but the render-only executable/CGI path still works fine).

Verified live, not just compiled: rebuilt jetc, compiled demo3.jet (a new
worked example with two #api lines sharing one handler) via
build-shared.sh into a real demo3.so, and added api_test.cpp (mirrors
host_test.cpp's dlopen()/dlsym() pattern) confirming jetc_api_demo3
returns the expected two routes at runtime. Re-ran host_test against the
same .so to confirm the render path is unaffected. Confirmed demo.jet/
demo2.jet (no #api lines) emit no JetApiRoute code at all - no regression
for templates that don't declare routes.

Also fixed a gitignore gap surfaced while committing this: an earlier
"jetc/*.cpp" ignore rule (meant for generated *.compiled.cpp output) was
a blanket pattern that silently hid this commit's own api_test.cpp from
git status. Narrowed to "jetc/*.compiled.cpp" (the actual generated-file
naming, per build-compiled.sh/build-shared.sh) and added explicit ignores
for the host_test/api_test/demo3 binaries plus two known stale generated
leftovers (demo.cpp/demo2.cpp) that predate this session.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
This commit is contained in:
Brad ArantandClaude Sonnet 5 committed 2026-08-25 10:24:10 -07:00
1 parent a32444acc2
commit 634eb7a9a9
6 files changed
+135 -15

No files matched your search

+16 -1
View File
@@ -173,7 +173,8 @@ namespace jetc {
}
std::string Codegen::generate(const std::vector<NodePtr> &top, const std::string &sourceFileComment,
bool sharedMode, const std::string &entrySymbol) {
bool sharedMode, const std::string &entrySymbol,
const std::vector<ApiRoute> &apiRoutes, const std::string &apiSymbol) {
out.str("");
out.clear();
out << "// " << sourceFileComment << "\n";
@@ -187,6 +188,20 @@ namespace jetc {
out << "#include <iostream>\n\n";
if (sharedMode) {
if (!apiRoutes.empty()) {
// A plain C struct, not any CoreUtils/JetCore type - this is the
// one piece of the plugin ABI a host loader needs to know about
// independent of the rest of this same-ABI C++ boundary.
out << "struct JetApiRoute { const char *method; const char *path; };\n";
out << "extern \"C\" const JetApiRoute *" << apiSymbol << "(int *count) {\n";
out << " static const JetApiRoute routes[] = {\n";
for (auto &r : apiRoutes)
out << " { " << cstr(r.method) << ", " << cstr(r.path) << " },\n";
out << " };\n";
out << " *count = " << apiRoutes.size() << ";\n";
out << " return routes;\n";
out << "}\n\n";
}
out << "extern \"C\" void " << entrySymbol << "(jet::Global &global, coreutils::MString &out) {\n";
out << " coreutils::ZString jetc_empty(\"\");\n";
out << " coreutils::MString jetc_scopeOut;\n";
+22 -1
View File
@@ -4,9 +4,19 @@
#include "JetAST.h"
#include <string>
#include <sstream>
#include <vector>
namespace jetc {
// One `#api METHOD /path` directive from the top of the source template
// (see jetc.cpp) - a compile-time-known route this template wants to
// serve once loaded as a .so. Purely descriptive data handed to Codegen;
// jetc itself never interprets the method/path beyond storing them.
struct ApiRoute {
std::string method;
std::string path;
};
// Emits a standalone .cpp translation unit that renders a compiled JET
// template. The static tag/text structure becomes real C++ control flow;
// anything genuinely dynamic (variable values, expr/value comparisons,
@@ -19,6 +29,8 @@ namespace jetc {
// sharedMode == false (default): emits a static jetc_render() plus a
// main() that runs it once, catches coreutils::Exception, and writes
// the result to stdout - the existing CGI-style standalone program.
// apiRoutes/apiSymbol are ignored in this mode (there's no host to
// dlsym them).
//
// sharedMode == true: emits no main() at all. Instead the render
// logic is exported as `extern "C" void <entrySymbol>(jet::Global
@@ -36,8 +48,17 @@ namespace jetc {
// template (see jetc.cpp) so multiple .so's can coexist even if a
// host ever dlopen()s them RTLD_GLOBAL instead of keeping separate
// handles.
//
// If apiRoutes is non-empty, sharedMode also emits a second exported
// function `extern "C" const JetApiRoute *<apiSymbol>(int *count)`
// returning a static array describing every `#api` directive the
// source declared - a host's directory watcher/loader dlsym()'s this
// (by the same filename-derived naming convention as entrySymbol) to
// learn what to register, without any separate manifest file that
// could drift out of sync with the render function it describes.
std::string generate(const std::vector<NodePtr> &top, const std::string &sourceFileComment,
bool sharedMode = false, const std::string &entrySymbol = "jetc_render");
bool sharedMode = false, const std::string &entrySymbol = "jetc_render",
const std::vector<ApiRoute> &apiRoutes = {}, const std::string &apiSymbol = "jetc_api");
private:
std::ostringstream out;
+39
View File
@@ -0,0 +1,39 @@
// Minimal dlsym() check for the jetc_api_<name> route-metadata export added
// alongside jetc_render_<name> in --shared mode (see JetCodegen.cpp). Proves
// a host can discover a compiled module's declared routes purely from the
// .so itself, with no separate manifest file - the actual point of putting
// routing metadata in an exported symbol instead of a sidecar file.
#include <dlfcn.h>
#include <iostream>
#include <cstdlib>
struct JetApiRoute { const char *method; const char *path; };
typedef const JetApiRoute *(*ApiFn)(int *count);
int main(int argc, char **argv) {
if (argc < 3) {
std::cerr << "usage: api_test <module.so> <api-symbol>" << std::endl;
return 1;
}
void *handle = dlopen(argv[1], RTLD_NOW);
if (!handle) {
std::cerr << "dlopen failed: " << dlerror() << std::endl;
return 1;
}
dlerror();
ApiFn api = (ApiFn)dlsym(handle, argv[2]);
const char *err = dlerror();
if (err) {
std::cerr << "dlsym failed: " << err << std::endl;
return 1;
}
int count = -1;
const JetApiRoute *routes = api(&count);
std::cout << count << " route(s):" << std::endl;
for (int i = 0; i < count; ++i)
std::cout << " " << routes[i].method << " " << routes[i].path << std::endl;
dlclose(handle);
return 0;
}
+4
View File
@@ -0,0 +1,4 @@
#!../jet-2.0
#api GET /hello
#api HEAD /hello
Hello, API world.
+43 -9
View File
@@ -58,24 +58,58 @@ int main(int argc, char **argv) {
src = (nl == std::string::npos) ? std::string() : src.substr(nl + 1);
}
// Consume zero or more leading "#api METHOD /path" directive lines
// (right after the optional shebang), the same way the shebang itself
// is stripped - a plain directive line, not a new tag/attribute concept,
// since jetc's parser has no existing notion of the enclosing <jet> tag's
// attributes to hang this off of. Each becomes one route this template
// wants to serve once loaded as a .so (see JetCodegen's apiRoutes).
std::vector<jetc::ApiRoute> apiRoutes;
while (src.rfind("#api ", 0) == 0) {
size_t nl = src.find('\n');
std::string line = (nl == std::string::npos) ? src : src.substr(0, nl);
src = (nl == std::string::npos) ? std::string() : src.substr(nl + 1);
std::istringstream ls(line);
std::string tag, method, path;
ls >> tag >> method >> path;
if (method.empty() || path.empty() || path[0] != '/') {
std::cerr << "jetc: malformed #api directive (expected \"#api METHOD /path\"): "
<< line << std::endl;
return 1;
}
for (auto &c : method) c = (char)std::toupper((unsigned char)c);
apiRoutes.push_back({method, path});
}
try {
jetc::Parser parser(src);
auto nodes = parser.parseNodes();
jetc::Codegen codegen;
// Symbol is derived from the input filename (not the output path) so
// it stays stable and predictable for whatever builds and dlsym()'s
// the resulting .so - unique per template, so multiple compiled
// templates' .so's can coexist in one process even under
// Both symbols are derived from the input filename (not the output
// path) so they stay stable and predictable for whatever builds and
// dlsym()'s the resulting .so - unique per template, so multiple
// compiled templates' .so's can coexist in one process even under
// dlopen(..., RTLD_GLOBAL) instead of requiring isolated handles.
std::string symbol = "jetc_render_" + sanitizeIdent(baseNameNoExt(inputPath));
std::string cpp = codegen.generate(nodes, std::string("compiled from ") + inputPath, shared, symbol);
std::string baseIdent = sanitizeIdent(baseNameNoExt(inputPath));
std::string symbol = "jetc_render_" + baseIdent;
std::string apiSymbol = "jetc_api_" + baseIdent;
if (!apiRoutes.empty() && !shared)
std::cerr << "jetc: warning: #api directive(s) present but --shared not specified - "
"route metadata will not be emitted" << std::endl;
std::string cpp = codegen.generate(nodes, std::string("compiled from ") + inputPath, shared,
symbol, apiRoutes, apiSymbol);
std::ofstream outFile(outputPath);
outFile << cpp;
outFile.close();
if (shared)
std::cout << "jetc: wrote " << outputPath << " (entry symbol: " << symbol << ")" << std::endl;
else
if (shared) {
std::cout << "jetc: wrote " << outputPath << " (entry symbol: " << symbol << ")";
if (!apiRoutes.empty())
std::cout << " (api symbol: " << apiSymbol << ", " << apiRoutes.size() << " route(s))";
std::cout << std::endl;
} else {
std::cout << "jetc: wrote " << outputPath << std::endl;
}
} catch (std::exception &e) {
std::cerr << "jetc: " << e.what() << std::endl;
return 1;