tcpdump mailing list archives
Re: endianness of portable BPF bytecode (DRAFT revision 4)
From: Denis Ovsienko via tcpdump-workers <tcpdump-workers () lists tcpdump org>
Date: Thu, 30 Jun 2022 20:14:32 +0100
--- Begin Message --- From: Denis Ovsienko <denis () ovsienko info>
Date: Thu, 30 Jun 2022 20:14:32 +0100
Hello list. Below is revision 4 of the document, unless anyone objects it will be committed to libpcap repository soonish, this way any remaining improvements can be made there when and as necessary. Changes from the previous revision are as follows: * fixup letter case * reword prose for clarity and brevity * move some fields from TLV space into the fixed header * introduce flags * reindex the TLVs * use more subsections * fixup assorted formatting ---------------------------------------------------------------------- CBPF-SAVEFILE(5) File Formats Manual CBPF-SAVEFILE(5) NAME cbpf-savefile - cBPF savefile format (work in progress, DRAFT revision 4) DESCRIPTION This man page discusses a file format for cBPF, which is the "classic" (and for a long time the only) Berkeley Packet Fil‐ ter. It does NOT apply to the newer eBPF variety of BPF. The main purpose of this file format is to store BPF bytecode, most commonly compiled from a BPF filter expression (see pcap- filter(7) for the filter syntax description) using libpcap. Besides that, the format allows to encode some information about the context in which the compilation was done. This meta-data can make it easier to reproduce the compilation later if required. cBPF savefile design is based on the file format proposed by C.S. Peron in 2005. Unless stated otherwise, in the following specification integer fields are big-endian unsigned, string fields do not use NUL character for termination or padding. FILE FORMAT A savefile consists of a fixed-size header and a variable-size body as follows: 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | 0xA1 | 0xB2 | 0xC3 | 0xCB | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | 'c' | 'B' | 'P' | 'F' | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | MajorVer=1 | MinorVer | Flags | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | SnapLen | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | LinkTypeValue | InstructionCount=n | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | | instruction 1 | | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | | instruction 2 | | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | | instruction n | | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | | optional trailing TLV space | | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ The first four octets contain a fixed signature, also known as a magic number, to make it easy to identify the file type auto‐ matically. The next four octets contain the ASCII string "cBPF" to provide a hint for manual identification. MajorVer and MinorVer Contain the major and the minor version numbers of this format respectively. The current major version is 1 and the current minor version is 0. Format changes that do not impact compati‐ bility (e.g., new TLV types or flags) increment the minor ver‐ sion only. Other format changes increment the major version and reset the minor version to 0. All format versions have the first part of the header up to and including MinorVer identi‐ cal. Flags b15 b14 b13 b12 b11 b10 b09 b08 b07 b06 b05 b04 b03 b02 b01 b00 +---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+ | reserved |CPX|COP|XOR|MOD| +---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+ MOD, XOR, COP and CPX: if set to 1, in this BPF dialect BPF_MOD, BPF_XOR, BPF_COP and BPF_COPX respectively are valid instructions. BPF_MOD and BPF_XOR are implemented in the OS kernel of FreeBSD, illumos, Linux, NetBSD and Solaris >= 11.4, but not AIX or OpenBSD. BPF_COP and BPF_COPX are implemented in NetBSD kernel. Note that the fact an instruction is valid in a BPF dialect does not always mean the compiled bytecode in the savefile con‐ tains the instruction. In other words, the purpose of the flags above is not to provide a digest of the file contents, but to enable conclusive automatic verification of the bytecode if required by the use case. SnapLen Contains the snapshot length used for the compilation, usually this is the snaplen input argument to pcap_open_dead(3PCAP) or pcap_set_snaplen(3PCAP). LinkTypeValue Contains the link-layer header type value used for the compila‐ tion, usually this is either the linktype input argument to pcap_open_dead() or the dlt input argument to pcap_set_datalink(3PCAP) or the value(s) returned by pcap_datalink(3PCAP) and pcap_list_datalinks(3PCAP). By con‐ vention link-layer header type values are limited to 16 bits. InstructionCount This is the last field of the fixed header in major version 1, it contains the number of bytecode instructions following the header. By convention, valid BPF bytecode must consist of at least one instruction, so in a valid savefile this field value is at least 1. The file format thus far minimizes the overhead for software that uses the BPF bytecode. If there is any data after the last instruction, it is the trailing TLV space, which mostly contains meta-data for human interpretation. It contains TLVs in the format specified below. INSTRUCTION FORMAT 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | opcode | jt | jf | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | k | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ This is the traditional encoding of a BPF instruction (a 4-tu‐ ple of integers). Note that usually the endianness depends on the machine, but in this format it is fixed. Some opcodes in‐ terpret k as a signed integer. TLV FORMAT 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Type | Length=m | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Value (m octets) ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ All TLVs are optional. Every TLV may appear in the same save‐ file at most once. Length value does not include Type and Length. Code points for Type and the associated Length con‐ straints are defined below. EOF TLV Allows to mark the end of TLV space (hence of the file) explic‐ itly to make it clear that the file is not truncated. If this TLV is present in the TLV space, it may appear the last only. Type is 0, Length is 0, Value is empty. LinkTypeName TLV Allows to record the input argument to pcap_datalink_name_to_val(3PCAP) if the latter was used to translate a DLT name into LinkTypeValue (the same name can sometimes produce different values in different contexts). Type is 1, Length is variable, Value contains an ASCII string. Filter TLV Allows to record the filter expression that was compiled into the bytecode, usually this is the str input argument to pcap_compile(3PCAP). Type is 2, Length is variable, Value contains an ASCII string. OptReq TLV Allows to record whether optimization was requested for the compilation or not, usually this is the optimize input argument to pcap_compile(). Note that some link-layer header types and filter keywords disable the optimization automatically in libp‐ cap. Type is 3, Length is 1, Value contains 1 or 0. Netmask TLV Allows to record the value of netmask input argument to pcap_compile(). Type is 4, Length is 4, Value contains a 32-bit IPv4 netmask. Comment TLV Allows to record a free-form text, for example, the name and version of the program that generated the file. Type is 5, Length is variable, Value contains a UTF-8 string. Timestamp TLV Allows to record when the compilation was performed. Type is 6, Length is 8, Value contains a 64-bit Unix timestamp. SOFTWARE SUPPORT None at the time of this writing. SEE ALSO pcap-savefile(5) 30 June 2022 CBPF-SAVEFILE(5) -- Denis Ovsienko
--- End Message ---
_______________________________________________ tcpdump-workers mailing list tcpdump-workers () lists tcpdump org https://lists.sandelman.ca/mailman/listinfo/tcpdump-workers
Current thread:
- endianness of portable BPF bytecode Denis Ovsienko via tcpdump-workers (Jun 02)
- Re: endianness of portable BPF bytecode Denis Ovsienko via tcpdump-workers (Jun 10)
- Re: endianness of portable BPF bytecode Guy Harris via tcpdump-workers (Jun 10)
- Message not available
- Re: endianness of portable BPF bytecode Denis Ovsienko via tcpdump-workers (Jun 10)
- Message not available
- Re: endianness of portable BPF bytecode Denis Ovsienko via tcpdump-workers (Jun 11)
- Re: endianness of portable BPF bytecode Denis Ovsienko via tcpdump-workers (Jun 10)
- Re: endianness of portable BPF bytecode (DRAFT revision 3) Denis Ovsienko via tcpdump-workers (Jun 25)
- Re: endianness of portable BPF bytecode (DRAFT revision 4) Denis Ovsienko via tcpdump-workers (Jun 30)