blob: ae57b9ea0d4169258b48b0531976b1a4a30eabae [file] [log] [blame]
Kyle Swenson8d8f6542021-03-15 11:02:55 -06001 =============================
2 NO-MMU MEMORY MAPPING SUPPORT
3 =============================
4
5The kernel has limited support for memory mapping under no-MMU conditions, such
6as are used in uClinux environments. From the userspace point of view, memory
7mapping is made use of in conjunction with the mmap() system call, the shmat()
8call and the execve() system call. From the kernel's point of view, execve()
9mapping is actually performed by the binfmt drivers, which call back into the
10mmap() routines to do the actual work.
11
12Memory mapping behaviour also involves the way fork(), vfork(), clone() and
13ptrace() work. Under uClinux there is no fork(), and clone() must be supplied
14the CLONE_VM flag.
15
16The behaviour is similar between the MMU and no-MMU cases, but not identical;
17and it's also much more restricted in the latter case:
18
19 (*) Anonymous mapping, MAP_PRIVATE
20
21 In the MMU case: VM regions backed by arbitrary pages; copy-on-write
22 across fork.
23
24 In the no-MMU case: VM regions backed by arbitrary contiguous runs of
25 pages.
26
27 (*) Anonymous mapping, MAP_SHARED
28
29 These behave very much like private mappings, except that they're
30 shared across fork() or clone() without CLONE_VM in the MMU case. Since
31 the no-MMU case doesn't support these, behaviour is identical to
32 MAP_PRIVATE there.
33
34 (*) File, MAP_PRIVATE, PROT_READ / PROT_EXEC, !PROT_WRITE
35
36 In the MMU case: VM regions backed by pages read from file; changes to
37 the underlying file are reflected in the mapping; copied across fork.
38
39 In the no-MMU case:
40
41 - If one exists, the kernel will re-use an existing mapping to the
42 same segment of the same file if that has compatible permissions,
43 even if this was created by another process.
44
45 - If possible, the file mapping will be directly on the backing device
46 if the backing device has the NOMMU_MAP_DIRECT capability and
47 appropriate mapping protection capabilities. Ramfs, romfs, cramfs
48 and mtd might all permit this.
49
50 - If the backing device device can't or won't permit direct sharing,
51 but does have the NOMMU_MAP_COPY capability, then a copy of the
52 appropriate bit of the file will be read into a contiguous bit of
53 memory and any extraneous space beyond the EOF will be cleared
54
55 - Writes to the file do not affect the mapping; writes to the mapping
56 are visible in other processes (no MMU protection), but should not
57 happen.
58
59 (*) File, MAP_PRIVATE, PROT_READ / PROT_EXEC, PROT_WRITE
60
61 In the MMU case: like the non-PROT_WRITE case, except that the pages in
62 question get copied before the write actually happens. From that point
63 on writes to the file underneath that page no longer get reflected into
64 the mapping's backing pages. The page is then backed by swap instead.
65
66 In the no-MMU case: works much like the non-PROT_WRITE case, except
67 that a copy is always taken and never shared.
68
69 (*) Regular file / blockdev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
70
71 In the MMU case: VM regions backed by pages read from file; changes to
72 pages written back to file; writes to file reflected into pages backing
73 mapping; shared across fork.
74
75 In the no-MMU case: not supported.
76
77 (*) Memory backed regular file, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
78
79 In the MMU case: As for ordinary regular files.
80
81 In the no-MMU case: The filesystem providing the memory-backed file
82 (such as ramfs or tmpfs) may choose to honour an open, truncate, mmap
83 sequence by providing a contiguous sequence of pages to map. In that
84 case, a shared-writable memory mapping will be possible. It will work
85 as for the MMU case. If the filesystem does not provide any such
86 support, then the mapping request will be denied.
87
88 (*) Memory backed blockdev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
89
90 In the MMU case: As for ordinary regular files.
91
92 In the no-MMU case: As for memory backed regular files, but the
93 blockdev must be able to provide a contiguous run of pages without
94 truncate being called. The ramdisk driver could do this if it allocated
95 all its memory as a contiguous array upfront.
96
97 (*) Memory backed chardev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
98
99 In the MMU case: As for ordinary regular files.
100
101 In the no-MMU case: The character device driver may choose to honour
102 the mmap() by providing direct access to the underlying device if it
103 provides memory or quasi-memory that can be accessed directly. Examples
104 of such are frame buffers and flash devices. If the driver does not
105 provide any such support, then the mapping request will be denied.
106
107
108============================
109FURTHER NOTES ON NO-MMU MMAP
110============================
111
112 (*) A request for a private mapping of a file may return a buffer that is not
113 page-aligned. This is because XIP may take place, and the data may not be
114 paged aligned in the backing store.
115
116 (*) A request for an anonymous mapping will always be page aligned. If
117 possible the size of the request should be a power of two otherwise some
118 of the space may be wasted as the kernel must allocate a power-of-2
119 granule but will only discard the excess if appropriately configured as
120 this has an effect on fragmentation.
121
122 (*) The memory allocated by a request for an anonymous mapping will normally
123 be cleared by the kernel before being returned in accordance with the
124 Linux man pages (ver 2.22 or later).
125
126 In the MMU case this can be achieved with reasonable performance as
127 regions are backed by virtual pages, with the contents only being mapped
128 to cleared physical pages when a write happens on that specific page
129 (prior to which, the pages are effectively mapped to the global zero page
130 from which reads can take place). This spreads out the time it takes to
131 initialize the contents of a page - depending on the write-usage of the
132 mapping.
133
134 In the no-MMU case, however, anonymous mappings are backed by physical
135 pages, and the entire map is cleared at allocation time. This can cause
136 significant delays during a userspace malloc() as the C library does an
137 anonymous mapping and the kernel then does a memset for the entire map.
138
139 However, for memory that isn't required to be precleared - such as that
140 returned by malloc() - mmap() can take a MAP_UNINITIALIZED flag to
141 indicate to the kernel that it shouldn't bother clearing the memory before
142 returning it. Note that CONFIG_MMAP_ALLOW_UNINITIALIZED must be enabled
143 to permit this, otherwise the flag will be ignored.
144
145 uClibc uses this to speed up malloc(), and the ELF-FDPIC binfmt uses this
146 to allocate the brk and stack region.
147
148 (*) A list of all the private copy and anonymous mappings on the system is
149 visible through /proc/maps in no-MMU mode.
150
151 (*) A list of all the mappings in use by a process is visible through
152 /proc/<pid>/maps in no-MMU mode.
153
154 (*) Supplying MAP_FIXED or a requesting a particular mapping address will
155 result in an error.
156
157 (*) Files mapped privately usually have to have a read method provided by the
158 driver or filesystem so that the contents can be read into the memory
159 allocated if mmap() chooses not to map the backing device directly. An
160 error will result if they don't. This is most likely to be encountered
161 with character device files, pipes, fifos and sockets.
162
163
164==========================
165INTERPROCESS SHARED MEMORY
166==========================
167
168Both SYSV IPC SHM shared memory and POSIX shared memory is supported in NOMMU
169mode. The former through the usual mechanism, the latter through files created
170on ramfs or tmpfs mounts.
171
172
173=======
174FUTEXES
175=======
176
177Futexes are supported in NOMMU mode if the arch supports them. An error will
178be given if an address passed to the futex system call lies outside the
179mappings made by a process or if the mapping in which the address lies does not
180support futexes (such as an I/O chardev mapping).
181
182
183=============
184NO-MMU MREMAP
185=============
186
187The mremap() function is partially supported. It may change the size of a
188mapping, and may move it[*] if MREMAP_MAYMOVE is specified and if the new size
189of the mapping exceeds the size of the slab object currently occupied by the
190memory to which the mapping refers, or if a smaller slab object could be used.
191
192MREMAP_FIXED is not supported, though it is ignored if there's no change of
193address and the object does not need to be moved.
194
195Shared mappings may not be moved. Shareable mappings may not be moved either,
196even if they are not currently shared.
197
198The mremap() function must be given an exact match for base address and size of
199a previously mapped object. It may not be used to create holes in existing
200mappings, move parts of existing mappings or resize parts of mappings. It must
201act on a complete mapping.
202
203[*] Not currently supported.
204
205
206============================================
207PROVIDING SHAREABLE CHARACTER DEVICE SUPPORT
208============================================
209
210To provide shareable character device support, a driver must provide a
211file->f_op->get_unmapped_area() operation. The mmap() routines will call this
212to get a proposed address for the mapping. This may return an error if it
213doesn't wish to honour the mapping because it's too long, at a weird offset,
214under some unsupported combination of flags or whatever.
215
216The driver should also provide backing device information with capabilities set
217to indicate the permitted types of mapping on such devices. The default is
218assumed to be readable and writable, not executable, and only shareable
219directly (can't be copied).
220
221The file->f_op->mmap() operation will be called to actually inaugurate the
222mapping. It can be rejected at that point. Returning the ENOSYS error will
223cause the mapping to be copied instead if NOMMU_MAP_COPY is specified.
224
225The vm_ops->close() routine will be invoked when the last mapping on a chardev
226is removed. An existing mapping will be shared, partially or not, if possible
227without notifying the driver.
228
229It is permitted also for the file->f_op->get_unmapped_area() operation to
230return -ENOSYS. This will be taken to mean that this operation just doesn't
231want to handle it, despite the fact it's got an operation. For instance, it
232might try directing the call to a secondary driver which turns out not to
233implement it. Such is the case for the framebuffer driver which attempts to
234direct the call to the device-specific driver. Under such circumstances, the
235mapping request will be rejected if NOMMU_MAP_COPY is not specified, and a
236copy mapped otherwise.
237
238IMPORTANT NOTE:
239
240 Some types of device may present a different appearance to anyone
241 looking at them in certain modes. Flash chips can be like this; for
242 instance if they're in programming or erase mode, you might see the
243 status reflected in the mapping, instead of the data.
244
245 In such a case, care must be taken lest userspace see a shared or a
246 private mapping showing such information when the driver is busy
247 controlling the device. Remember especially: private executable
248 mappings may still be mapped directly off the device under some
249 circumstances!
250
251
252==============================================
253PROVIDING SHAREABLE MEMORY-BACKED FILE SUPPORT
254==============================================
255
256Provision of shared mappings on memory backed files is similar to the provision
257of support for shared mapped character devices. The main difference is that the
258filesystem providing the service will probably allocate a contiguous collection
259of pages and permit mappings to be made on that.
260
261It is recommended that a truncate operation applied to such a file that
262increases the file size, if that file is empty, be taken as a request to gather
263enough pages to honour a mapping. This is required to support POSIX shared
264memory.
265
266Memory backed devices are indicated by the mapping's backing device info having
267the memory_backed flag set.
268
269
270========================================
271PROVIDING SHAREABLE BLOCK DEVICE SUPPORT
272========================================
273
274Provision of shared mappings on block device files is exactly the same as for
275character devices. If there isn't a real device underneath, then the driver
276should allocate sufficient contiguous memory to honour any supported mapping.
277
278
279=================================
280ADJUSTING PAGE TRIMMING BEHAVIOUR
281=================================
282
283NOMMU mmap automatically rounds up to the nearest power-of-2 number of pages
284when performing an allocation. This can have adverse effects on memory
285fragmentation, and as such, is left configurable. The default behaviour is to
286aggressively trim allocations and discard any excess pages back in to the page
287allocator. In order to retain finer-grained control over fragmentation, this
288behaviour can either be disabled completely, or bumped up to a higher page
289watermark where trimming begins.
290
291Page trimming behaviour is configurable via the sysctl `vm.nr_trim_pages'.