Utilisation of Design of Experiments Approach to Optimise Supercritical Fluid Extraction of Medicinal Cannabis

TRADELABOR has more than 20 years of experience in the control and treatment of air, working with an experienced and qualified technical staff and with the most advanced technology in this area, which together guarantee the quality of the services provided.




Carbon dioxide supercritical fluid extraction (CO2 SFE) is a clean and cost-effective method of extracting cannabinoids from cannabis. Using design of experiment methodologies an optimised protocol for extraction of medicinal cannabis bud material (population of mixed plants, combined THC:CBD approximately 1:1.5) was developed at a scale of one kg per extraction. Key variables investigated were CO2 flow rate, extraction time and extraction pressure. A total of 15 batches were analysed for process development using a two-level, full factorial design of experiments for three variable factors over eleven batches. The initial eleven batches demonstrated that CO2 flow rate has the most influence on the overall yield and recovery of the key cannabinoids, particularly CBD. The additional four batches were conducted as replicated runs at high flow rates to determine reproducibility. The highest extraction weight of 71 g (7.1%) was obtained under high flow rate (150 g/min), with long extraction time (600 min) at high pressure (320 bar). This method also gave the best recoveries of THC and CBD. This is the first study to report the repeated extraction of large amounts of cannabis (total 15 kg) to optimise the CO2 SFE extraction process for a pharmaceutical product.


Cannabis is an herbaceous flowering plant of the Cannabis genus (Rosale) that has been used for its fibre and medicinal properties for thousands of years1,2. In recent decades medicinal cannabis has become legal in several jurisdictions and the possibility of legalisation is being explored in many more3,4,5,6,7,8. The chemistry of cannabis is rich and varied; it includes phytocannabinoids, terpenes and phenolics, and each of these classes contain compounds with biological activity9. The cannabinoids, in particular, Δ9-tetrahydrocannabinol (THC) and cannabidiol (CBD) have been the main focus of bioactive research. These cannabinoids are naturally present in planta as their acid analogues Δ9-tetrahydrocannabinolic acid (THCA) and cannabidiolic acid (CBDA). THCA and CBDA are the major cannabinoids found in cannabis although more than 90 cannabinoids have been reported9. The acids degrade naturally to the corresponding neutral species at a slow rate via non-enzymatic processes10. Decarboxylation is facilitated by heating (e.g. when smoked) (Citti et al. 2018). Many medicinal cannabis preparations are consumed in an oil or are made from an extracted resin and not smoked. In this case, the dried cannabis material must be ‘cured’ prior to, or during, extraction (i.e. heated for a specific time and temperature to ensure maximum decarboxylation). THCA is the main psychoactive cannabinoid followed by cannabigerolic acid (CBGA).

Medicinal cannabis is consumed by patients using a variety of methods including smoking, vaping and consuming infused oils or other edible products. One of the issues associated with smoking or vaping is that the dose the patient receives is not reliable due to both the variability in plant product and the way patients inhale and hold vapour11. Vaping and smoking also have well known negative health effects and is particularly undesirable for juvenile patients. For this reason, the production of an extract that can be formulated in various ways is becoming more popular. The cannabinoids are non-polar compounds with low water solubility and can be extracted using a range of different organic solvents including hydrocarbons (e.g. hexane) and alcohols (e.g. ethanol). Extractions using these solvents can be efficient but depending on the final product, can impact regulation and require additional testing. For instance, residual solvent must be defined for medicines under good manufacturing practice (GMP). These solvents can also be costly and due to their toxicity, environmental risk and flammability are less desirable for large scale extractions.

Supercritical fluid extraction (SFE) can eliminate the need for these organic solvents during the manufacture of medicinal cannabis extracts. Carbon dioxide (CO2) is the main solvent in SFE. It has GRAS (generally recognised as safe) status and evaporates from the extract when exposed to normal atmospheric conditions. The majority of the published studies on SFE of cannabis are either at small/analytical scale12 or on hemp material that contains low levels of cannabinoids and very little THC13,14,15,16,17,18. There have been studies investigating the solubility of THC and CBN (cannabinol, a degradation product of THC) in supercritical CO2 suggesting that temperature and pressure are critical parameters19,20. A more recent study evaluated the use of the Waters Bio-botanical extraction system with the use of ethanol as a co-solvent with CO2 extraction using four cannabis samples (500 g each) with THCA:CBDA content of 15:1 or more. The authors noted extraction efficiency was highly linked to pressure as well as cannabinoid content of the plant material21.

This study was undertaken as part of our efforts to obtain a GMP license to produce pharmaceutical grade medicinal cannabis. In order to simplify the regulatory process, and produce a cleaner product, we chose to avoid the use of co-solvents such as ethanol. Process development (PD) is part of GMP. The aim of PD to ensure that the factors underlying any manufacturing protocols are well understood so that any potential source of product variation can be better managed to ensure a safe and consistent pharmaceutical product. As part of GMP PD we used design of experiments (DOE) methodology to develop an extraction method for medicinal cannabis. The aim of DOE was to explore the factors influencing the extraction of cannabinoids and optimise the process for extraction of cannabis material at a pharmaceutical scale.

DOE is commonly used to optimise engineering processes and to determine which process inputs have a significant effect on process outputs. In a factorial design each variable, or factor, is investigated at predefined levels. With a two-level factorial design each factor can be one of two values. For continuous variables, this is a high and a low level of the variable under investigation22. Importantly, the methodology can also determine if there are interactions between the factors in the process. This allows for more rapid optimisation of processes than if single variables were considered independently. This methodology has been used to investigate factors important in extraction of biomaterials. For example, Prasad et al. explored the effect of five factors (pH, ethanol concentration, temperature, time and liquid to solid ratio) on four responses (extract yield, antioxidant capacity, phenolics and flavonoids) for the extraction of the Malaysian fruit, Mangifera pajang23. Lee et al. analysed similar factors to optimise the recovery of phenolics, flavonoids and anti-oxidants from palm-kernel by-products24. A review of the literature by Reverchon and De Marco demonstrated that CO2 flow rate, extraction pressure and extraction time are the critical parameters in SFE for the extraction of natural materials25. Therefore, these were the factors considered in this study.

Results and Discussion

The factors considered in this study were the CO2 flowrate, the extraction time, extraction pressure, recoveries of CBD and THC and the final extract weight (Table 1). The range of values for factors was based on review of the literature and the recommendations of the instrument manufacture (Waters). For example, if the flow rate is too low the system will not function properly and if it is too high it will shut down due to over pressurisation. The temperature of the extraction vessels was set at 60 °C based on the recommendation of the manufacture. If we consider %CBD recovery (response 1 in Table 1), from the initial two-level factorial extractions (runs 1 to 8), the four lowest recovery rates correspond to the four low flow rate runs; i.e., runs 2, 3, 4 and 6. Only when combined with maximum time and pressure (run 6), did low flow rates produce CBD recoveries which approached the high recoveries produced at high flow rate.

Table 1 Experimental design and results of extraction (rows coloured by experiment: white indicates the initial factorial designed runs, light grey indicates mid-point runs, dark grey indicates repeat runs).

Generally speaking, of the initial two-level factorial runs (1 to 8), the high flow rates (150 g/min) produced excellent CBD recovery, with all exceeding 90% of theoretical yield. The yields of each run are compared in Fig. 1.

Figure 1

Comparison of CBD, THC and total resin yield for each PD run. CBD: solid black bars, THC: light grey bars outlined in black, Total Extract Weight: solid grey bars.

When analysed statistically, the CO2 flow rate is shown to have largest effect on CBD recovery. Extraction pressure had the least overall impact to CBD recovery even when combined with other factors (Table 2).

Table 2 Result of statistical analysis of Response 1– %CBD Recovery.

The effect of factors on THC recovery is not as clear cut as for CBD. While three of the four lowest recoveries were obtained in low flow rate runs, the 2nd best result was also recorded on a flow rate run at 95 g/min. The other factors (time and pressure), and in particular, interactions between these factors also appear to have an impact (Table 3)

Table 3 Result of statistical analysis of Response 2– %THC Recovery.

When analysed statistically, the CO2 flowrate has the highest effect, but there are a number of other significant effects (Table 3).

Extraction weight seems to be most significantly influenced by CO2 flow rate and extraction time, with smaller influence from extraction pressure. Statistical analysis (Table 4) confirms this.

Table 4 Result of statistical analysis of Response 3– % Extraction weight.

The highest extraction weight of 71 g (7.1%) was obtained under high flow rate (150 g/min), with long extraction time (600 min) at high pressure (320 bar). This method also gave the best recoveries of THC and CBD (Table 3). The lowest extraction weight of 4.2 g (0.42%) was obtained with low flow rate (40 g/min) and short extraction time (240 min) even though the extraction pressure was high (320 bar). Runs 5–8 produced very similar quantities (50.8 g to 56.3 g) even though the extraction times were 240 min and 600 min, indicating that a longer extraction time did not necessarily increase the amount of extract. The three centre point runs (9–11) produced extraction weights as good or better than runs 2–8. The last four runs (12–15) were duplicates of runs 1, 5, 7 and 8. With the exception of run 13, the yields from the duplicate runs were similar (within 3 g).

When the concentration of CBD and THC in each extract are compared, it is clear that the different run conditions do affect CBD and THC differently (Table 5). The ratio of CBD:THC varies from 0.5 to 1.6. The CBD:THC ratio in the cured material is approximately 0.7 and the data shows that this ratio can be increased if the flow rate is decreased, however, there is significant cost to yield (a maximum yield of 27.5 g compared to 71.0 g)

Table 5 Quantity of CBD and THC in the extract and the ratio between them in each run.

Despite this reduction in extraction weight, there may be value in this approach if there is a need for medicinal purposes. For example, high CBD and low (or no) THC is currently desirable for the treatment of epilepsy in children26. For a plant biomass exhibiting high CBD and low THC, this method may be optimised further so that low levels of THC could be removed. Based on the current study the optimised method for maximising the levels of either CBD or THC in the extract would be different. Analysis using Design Expert software suggests that extraction pressure would have the greatest effect in this case (Table 6).

Table 6 Optimisation of parameters to maximise CBD or THC.

These findings are in line with the literature on cannabinoid solubility in supercritical CO2. Perrotin-Brunel et al. found that CBD is more soluble than THC at both 42 °C and 52 °C over pressures from 110 bar to 210 bar19,20,27. They also note that CBD and THC might be separated by using a two-step process, first extracting CBD at 130 bar then extracting THC at 320 bar (close to the parameters suggested in Table 6)27.

Of course, cannabinoids are not the only metabolites extracted from cannabis biomass. Attard et al. demonstrated that in the SFE of hemp waste fatty acids, fatty aldehydes, wax esters, alkanes, sterols and n-policosanols were extracted along with CBD and that different parameters could alter the amount of these other metabolites17. In our study between 32% and 61% of the extract is made up of other components. While our study did not investigate these other metabolites, it is clear that our extraction variables also affect the amounts of these metabolites in our final extract. Different cannabis plants will have different levels of the cannabinoids as well as these other metabolites. It is therefore anticipated that for GMP extraction of any new biomaterial PD would need to be repeated and extraction optimised for that specific cannabis material.


CBD and THC can be extracted with high efficiency from cured cannabis biomass using supercritical CO2 without a co-solvent. The design of experiments approach allowed efficient sampling of CO2 flow rates, CO2 pressures and extraction times to assess the impact these variables have on recovery of CBD, recovery of THC and total extract yield. The extraction of CBD is largely dependent on flow rate while, the extraction of THC is dependent on both flow rate and extraction time. In terms of cannabinoid recoveries and extract yield the optimal extraction parameters for the biomass used in this study was a flow rate of 150 g/min, an extraction time of 600 min and an extraction pressure of 320 bar.

Materials and methods

Chemicals and equipment

The CO2 was food grade (99.5% with less than 17.5 ppm water) and obtained from CoreGas (Thomastown, Victoria, Australia). All HPLC grade reagents, water with 0.1% formic acid (mobile phase A), acetonitrile with 0.1% formic acid (mobile phase B) and methanol were obtained from Fisher Scientific (Fair Lawn, New Jersey, USA). Primary standards for CBDA and THCA in acetonitrile, and CBD, CBN, CBC, THC in methanol, at 1000 μg/mL, were purchased from Novachem Pty Ltd (Heidelberg West, Victoria, Australia) as distributor for Cerilliant Corporation (Round Rock, Texas, USA). Glass marbles (12 mm, clear, MoreWine, CA) were used to top up the baskets to fill the void space after packing the cannabis material.

Cannabis material

Dried and ground plant material was obtained from the Victorian Government Medicinal Cannabis Cultivation Facility. Biomass was combined from cannabis plants of varying genotype and chemotype to provide 18 kg of material of composite material with CBD:THC ratio of approximately 1:1.5. Coarsely ground biomass samples were cured at 120 °C for 2 hours facilitating the conversion of CBDA to CBD and THCA to THC. Subsamples of the cured material were ground to a fine powder and analysed to provide baseline cannabinoid content data using UHPLC analytical methods as described previously28.

Supercritical carbon dioxide extraction of cannabis biomass

The Waters Bio-Botanical extraction system29 was used throughout PD (Schematic, Fig. 2). The system is commercially available and was fitted with two extraction vessels (5 L, though only one was used for PD), three collection vessels (cyclones) and a recycler to recover CO2. The extraction vessels were equipped with removable baskets that facilitate the transfer of cannabis to and from the system. The extraction vessels were maintained at 60 °C (via heated jacket) for all runs. The extraction pressure is maintained automatically by the ABPR (automatically actuated back pressure regulator) which is an actuated needle valve. The three collection vessels are independently heated and fitted with manual back pressure regulators. These regulators were set as suggested by the manufacturer to 750 psi, 1200 psi and 2000 psi and the temperatures set to 35 °C, 50 °C and 55 °C, respectively. The system is controlled by ChromScope v1.6 (Waters).

Figure 2

Schematic of the SFE set up. CS = cyclonic separator (cyclone), BPR = manually adjusted back pressure regulator (adapted from Rovetto and Aieta21).

We were not interested in assessing the capability of the system to separate different fractions and so the extract in each cyclone was combined prior to analysis. For each PD run the baskets were packed with the cured cannabis biomass (1.0 kg). The material was manually packed tight into the baskets using a custom-made stainless-steel plunger. The remaining space in the basket was filled with food grade glass marbles. The extraction programs were set up as described in Table 4.

Cannabinoid content of the resin was determined using UHPLC analytical methods described previously28. The %CBD and %THC recoveries were calculated by comparing the concentration in the resin and the total cannabinoid extracted to the amount available in the biomass.

Experimental design

PD was designed and the data interpreted using Design Expert (Stat-Ease, version 10), which is a commercial, off-the-shelf Design of Experiments package. The system uses standard statistical methodology, such as analysis of variance (ANOVA), to determine the factors influencing responses that are critical to the final product (e.g. extraction weight). Additionally, it considers interactions between the different factors to determine if there are any synergistic effects between them.

The effects of interactions are represented by factor identifications (i.e. AB is the interaction effect of factors A and B). The standardised effect represents the degree to which a factor exhibits a positive or negative effect on the response (as indicated by the sign of the number), while the % contribution estimates the factor’s overall influence on the response. The software was used to model various combinations of factors to determine process optimisation. Literature demonstrates that CO2 flow rate, extraction pressure and extraction time are the critical parameters in SFE25.

Therefore, the three factors chosen for variance were:

  • Factor A: CO2 flow rate, 40–150 g/min
  • Factor B: Extraction pressure, 150–320 bar
  • Factor C: Extraction time, 4–10 hours

The parameters used to assess extraction efficiency were:

  • Response 1: %CBD recovery
  • Response 2: %THC recovery
  • Response 3: Extraction weight (g)

A total of 15 extractions were analysed for PD using a two-level, full factorial design of experiments for three variable factors over eight runs (1 to 8, Table 1), three mid-point runs (9 to 11, Table 1) and four additional extractions were conducted as replicated runs at high flow rates to determine reproducibility (runs 12 to 15, Table 1).


  1. 1.

    Brunner, T. F. Marijuana in ancient greece and rome? The literary evidence. Bull His Med 47, 344–355 (1973).

    CAS Google Scholar

  2. 2.

    ElSohly, M. A. & Slade, D. Chemical constituents of marijuana: The complex mixture of natural cannabinoids. Life Sci. 78, 539–548, https://doi.org/10.1016/j.lfs.2005.09.011 (2005).

    CAS Article PubMed Google Scholar

  3. 3.

    Ghiabi, M., Maarefvand, M., Bahari, H. & Alavi, Z. Islam and cannabis: Legalisation and religious debate in Iran. Int. J. Drug Policy 56, 121–127, https://doi.org/10.1016/j.drugpo.2018.03.009 (2018).

    Article PubMed PubMed Central Google Scholar

  4. 4.

    Cruz, J. M., Fernanda Boidi, M. & Queirolo, R. The status of support for cannabis regulation in Uruguay 4 years after reform: Evidence from public opinion surveys. Drug Alcohol Rev. 37, S429–S434, https://doi.org/10.1111/dar.12642 (2018).

    Article PubMed Google Scholar

  5. 5.

    Bone, M., Potter, G. & Klein, A. Introduction: cultivation, medication, activism and cannabis policy. Drugs and Alcohol Today 18, 73–79, https://doi.org/10.1108/dat-03-2018-0014 (2018).

    Article Google Scholar

  6. 6.

    Bradford, A. C. & Bradford, W. D. Factors driving the diffusion of medical marijuana legalisation in the United States. Drugs-Education Prevention and Policy 24, 75–84, https://doi.org/10.3109/09687637.2016.1158239 (2017).

    Article Google Scholar

  7. 7.

    Wilkins, C. After the legalisation of cannabis: the Cannabis Incorporated Society (CIS) regulatory model for recreational cannabis in New Zealand. N.Z. Med. J. 129, 74–77 (2016).

    PubMed Google Scholar

  8. 8.

    Wright, R. Cannabis Industry Report. 40 (EverBlu Capital, https://www.everblucapital.com/wp-content/uploads/2017/11/EverBlu-Research-Cannabis-Industry-Report.pdf, 2017).

  9. 9.

    Andre, C. M., Hausman, J.-F. & Guerriero, G. Cannabis sativa: The Plant of the Thousand and One Molecules. Front Plant Sci 7https://doi.org/10.3389/fpls.2016.00019 (2016).

  10. 10.

    Flores-Sanchez, I. J. & Verpoorte, R. Secondary metabolism in Cannabis. Phytochem. Rev. 7, 615–639, https://doi.org/10.1007/s11101-008-9094-4 (2008).

    CAS Article Google Scholar

  11. 11.

    Lewis, M. M., Yang, Y., Wasilewski, E., Clarke, H. A. & Kotra, L. P. Chemical Profiling of Medical Cannabis Extracts. ACS Omega 2, 6091–6103, https://doi.org/10.1021/acsomega.7b00996 (2017).

    CAS Article PubMed PubMed Central Google Scholar

  12. 12.

    Omar, J., Olivares, M., Alzaga, M. & Etxebarria, N. Optimisation and characterisation of marihuana extracts obtained by supercritical fluid extraction and focused ultrasound extraction and retention time locking GC-MS. J. Sep. Sci. 36, 1397–1404, https://doi.org/10.1002/jssc.201201103 (2013).

    CAS Article PubMed Google Scholar

  13. 13.

    Da Porto, C., Decorti, D. & Natolino, A. Separation of aroma compounds from industrial hemp inflorescences (Cannabis sativa L.) by supercritical CO2 extraction and on-line fractionation. Ind. Crops. Prod. 58, 99–103, https://doi.org/10.1016/j.indcrop.2014.03.042 (2014).

    CAS Article Google Scholar

  14. 14.

    Aladic, K. et al. Cold Pressing and Supercritical CO2 Extraction of Hemp (Cannabis sativa) Seed Oil. Chem. Biochem. Eng. Q. 28, 481–490 (2014).

    CAS Article Google Scholar

  15. 15.

    Da Porto, C., Natolino, A. & Decorti, D. Effect of ultrasound pre-treatment of hemp (Cannabis sativa L.) seed on supercritical CO2 extraction of oil. J Food Sci Tech Mysore 52, 1748–1753, https://doi.org/10.1007/s13197-013-1143-3 (2015).

    CAS Article Google Scholar

  16. 16.

    Brighenti, V., Pellati, F., Steinbach, M., Maran, D. & Benvenuti, S. Development of a new extraction technique and HPLC method for the analysis of non-psychoactive cannabinoids in fibre-type Cannabis sativa L. (hemp). J. Pharm. Biomed. Anal. 143, 228–236, https://doi.org/10.1016/j.jpba.2017.05.049 (2017).

    CAS Article PubMed Google Scholar

  17. 17.

    Attard, T. M. et al. Utilisation of supercritical fluids for the effective extraction of waxes and Cannabidiol (CBD) from hemp wastes. Ind. Crops. Prod. 112, 38–46, https://doi.org/10.1016/j.indcrop.2017.10.045 (2018).

    CAS Article Google Scholar

  18. 18.

    Devi, V. & Khanam, S. Comparative study of different extraction processes for hemp (Cannabis sativa) seed oil considering physical, chemical and industrial-scale economic aspects. J Clean Prod 207, 645–657, https://doi.org/10.1016/j.jclepro.2018.10.036 (2019).

    CAS Article Google Scholar

  19. 19.

    Perrotin-Brunel, H. et al. Solubility of Cannabinol in Supercritical Carbon Dioxide. J. Chem. Eng. Data 55, 3704–3707, https://doi.org/10.1021/je100245n (2010).

    CAS Article Google Scholar

  20. 20.

    Perrotin-Brunel, H. et al. Solubility of Delta(9)-tetrahydrocannabinol in supercritical carbon dioxide: Experiments and modeling. J. Supercrit. Fluids 52, 6–10, https://doi.org/10.1016/j.supflu.2009.12.001 (2010).

    CAS Article Google Scholar

  21. 21.

    Rovetto, L. J. & Aieta, N. V. Supercritical carbon dioxide extraction of cannabinoids from Cannabis sativa L. J. Supercrit. Fluids 129, 16–27, https://doi.org/10.1016/j.supflu.2017.03.014 (2017).

    CAS Article Google Scholar

  22. 22.

    Carlson, R. in Data Handling in Science and Technology Vol. 8 (ed Rolf Carlson) 89-122 (Elsevier, 1992).

  23. 23.

    Prasad, K. N., Kong, K. W., Ramanan, R. N., Azlan, A. & Ismail, A. Selection of Experimental Domain using Two-Level Factorial Design to Determine Extract Yield, Antioxidant Capacity, Phenolics, and Flavonoids from Mangifera pajang Kosterm. SS&T 47, 2417–2423, https://doi.org/10.1080/01496395.2012.672511 (2012).

    CAS Article Google Scholar

  24. 24.

    Lee, W. X. et al. Two level half factorial design for the extraction of phenolics, flavonoids and antioxidants recovery from palm kernel by-product. Ind. Crops. Prod. 63, 238–248, https://doi.org/10.1016/j.indcrop.2014.09.049 (2015).

    CAS Article Google Scholar

  25. 25.

    Reverchon, E. & De Marco, I. Supercritical fluid extraction and fractionation of natural matter. J. Supercrit. Fluids 38, 146–166, https://doi.org/10.1016/j.supflu.2006.03.020 (2006).

    CAS Article Google Scholar

  26. 26.

    Tzadok, M. et al. CBD-enriched medical cannabis for intractable pediatric epilepsy: The current Israeli experience. Seizure 35, 41–44, https://doi.org/10.1016/j.seizure.2016.01.004 (2016).

    Article PubMed Google Scholar

  27. 27.

    Perrotin-Brunel, H. et al. Solubility of non-psychoactive cannabinoids in supercritical carbon dioxide and comparison with psychoactive cannabinoids. J. Supercrit. Fluids 55, 603–608, https://doi.org/10.1016/j.supflu.2010.09.011 (2010).

    CAS Article Google Scholar

  28. 28.

    Elkins, A. C., Deseo, M. A., Rochfort, S., Ezernieks, V. & Spangenberg, G. Development of a validated method for the qualitative and quantitative analysis of cannabinoids in plant biomass and medicinal cannabis resin extracts obtained by super-critical fluid extraction. J Chromatogr B Analyt Technol Biomed Life Sci 1109, 76–83, https://doi.org/10.1016/j.jchromb.2019.01.027 (2019).

    CAS Article PubMed Google Scholar

  29. 29.

    Waters, E. J. SFE Bio-Botanical Extraction System, https://www.waters.com/waters/en_US/For-SFE-extraction-and-CO2-extraction/nav.htm?cid=134826287&locale=en_US> (2019).


Download PDF File



Continue at:  https://www.nature.com/articles/s41598-020-66119-1


The text above is owned by the site above referred.

Here is only a small part of the article, for more please follow the link

Also see:



Manostaxx – Industrial Management Consulting

Leave a Reply

Your email address will not be published. Required fields are marked *